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approaches and an oral lanouaae stimulation nrforar. with inn°r-citv 
Southern d i sa dvan ta qed children. This to' lovut> study locKoa for 
differences arena the treatment orouts after ounils had corrplefed 
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lessons, while much of this progress was lost in followup tes‘inc. 
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COOPERATIVE READING PROJECT 



The Ef fectiveness of Three Reading Approaches and an Oral Language 
Stimulation Program with Disadvantaged Children in the Primary 
Grades: A Followup Report After the Third Grade^ 



by 

Lloyd M. Dunn and Robert H, Bruininks 

Institute on Mental Retardation and Intellectual Development 
George Peabody College for Teachers 
Nashville, Tennessee 37203 

This is a followup report on our Coop e rat ive Reading Proj ec t . This 
project was a two-year study designed to test the efficacy of three 
initial reading approaches and an oral language stimulation program with 
inner-city Southern disadvantaged children. An interim report was written 
after the first year of the project (Dunn, Neville, Bailey, Pochanart, h 
Pfost, 1967). A final report was prepared after the termination 
of the two-year experimental phase when the children had finished their 
second grade (Duin, Neville, Pfost, Pochanart, 4 Bruininks, 1968). 



The research reported herein is part of our Cooperative Readin g 
Project supported by Grant #HD 973 from the National Institute of Child 
Health and Human Development, and by Ford Foundation funds through the 
Nashville Education Improvement Project. This experiment was carried 
out in collaboration with the Nashville Metropolitan Schools. Acknowledge- 
ments are extended to the itAny teachers and adminis trators who partici- 
pated in this study. Special recognition ts due M. D, Neely, Coordinator 
of Special Projects in the Nashville Metro School System, who was the 
fcain force in the school district behind the execution of this experiment. 

the two earlier reports— -after one year, and after two years-- 
included the authorships of Donald Neville, Carolyn F. Bailey, Prayot 
Pochanart, and Philip Pfost. Dr. Neville coordinated the supplemented 
conventional reading program, and Dr. Bailey the vords-in-colot reading 
approach. Mr. Pochanatt and Dr. Pfost were largely responsible for data 
collection and analyses. 



ill i s followup report provides data on the subjects when they were 
finishing their third grade, and one year aftsr the experiment was 
completed, A complete description of the project appears in the two 
earlier monographs. The reader is referred back to these previous 
monographs for a more extensive discussion of the research design, 
review of the literature, measurement instruments, intervention treat- 
ments, and results. The present report is restricted largely to the 
results of the followup study. 

The Cooperative Heading P roject (CRP) was a direct outgrowth of our 
earlier three-year Cooperative Language Developme nt Project (ClDP) I n 
the ClDP, the efficacy of the I nitial Teaching Alphabe t (1TA) for teaching 
beginning reading, and the lessons from the Peabody Language De velop - 
ment Kits for stimulating oral language, were investigated among inner- 
city, disadvantaged children in the Metropolitan School System of 
Nashville-Davidson County. In this earlier study, both the ITA and PLDK 
treatments were found to be quite effective (see Dunn, Pochanart, Pfcst, 

6 Bruininks, 1968). in fact, even one year after this first experiment 
had terminated and the children were completing their fourth grade, the 
ITA and °LDK treatment groups were generally ©ore advanced than the 
controls, especially for the subjects who had ITA in combination with 
two or three years of the PLDK lessons. On the basis of these positive 
results, it might have been concluded that a language program using ITA 
plus PLDK should be incorporated into school programs for such children. 
However, the possibility existed that these results may have been due to 
a number of factors beyond the control of the project staff. Since 
assignment to experiaental treatments was nade by schools and by the 
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See the four relevant reports in the list of references at the end 
of this paper under tkinn et al., 1966, 1967, 1968, 1968. 
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central office staff of the school system, selection bias may have been 
inadvertently introduced. Moreover, the Hawthorne Effect cannot be 
ignored. The experimental teachers were given a number of incentives 
which were not available to the control teachers — including a small 
salary supplement, in-service training sessions, extra consultation, as 
well as the stimulation created by the novelty of being involved in the 
experimental treatments. Furthermore, frequent visits to the experimental 
classes were made by researchers, school officials, and visitors who 
praised the pupils' progress. The question thus arises as to whether 
the Initial Teaching Alphabet and the Peabody Language Developmen t Kit 
materials would continue to be effective when this study was replicated 
with other teachers, and with other approaches to beginning reading 
where similar extra support and incentives were included. The central 
purpose of the Cooperat ive Reading Project (CRP) was to deal with this 
ques tion . 



Purpose 

The primary aim of the project was to examine the relative effective- 
ness of different amounts of oral language s timulat ion ,and of three 
experimental approaches to teaching beginning reading, with disadvantaged 
children. Comparable teacher incentives and support were provided in 
all three reading approaches, and the experimental phase extended over 
the first two years in school for the subjects. The followup study 
sought to determine if any differences would be discernible among the 
various treatment groups after the pupils had com 1 leted their third 
year in school. 
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METHOD 

Research Design 

Subjects were enrolled in twelve elementary schools, with nine 
schools involved in the experimental programs and three providing non- 
treatment , control subjects. All these schools were located in low 
socioeconomic areas of the inner city of Nashville, Tennessee, and the 
majority served mostly children of the Negro race. 

The three experimental reading treatments were (1) a highly -phonic , 
basal reading approach using the 44 sound-symbol, Initial Teaching 
Alphabet (ITA), (2) the Words -in- Color (WIC) program which introduces 
each of the 47 speech sounds of the English language (as identified by 
the author) through the use of a distinct color, (3) and a Suppl emented 
Conventional Reading Frogram (SCRP) combining a basic reader series with 
a systematic phonics jprogram. In addition to the reading treatments, 
two-thirds of the classes in the experimental treatments, during the 
first year of the project, received an oral stimulation program using 
Level #1 of the Peabody Language Development Kits (PLDK) „ Half of these 
classes who had used PLDK #1 in the first year of the experiment received 
Level \\2 of the PLDK during its second year. The yearly PLDK program 
consisted of 180 thirty-minute daily lessons designed to stimulate oral 
language and verbal intelligence, and thus enhance schuol progress. 

Nine experimental treatment conditions were established at the outset 
of the experiment, (Each of the nine consisted of three teachers who 
were committed to keeping their pupils through the first two years of 
school. None of the teachers had participated in our earlier Cooperative 
Language Developmen t Project . ) For each of the three approaches to 
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beginning reading — ITA, WIC, SCRP — three oral language treatments were 
established. Within each reading treatment, one-third of the children 
received no PLDK, one-third received one year of PLDK, and one-third 
received two years of PLDK. This yielded the nine experimental groups 
identified in Figure J . Examination of Figure 1 reveals that Groups 1, 
4, and 7 (the without PLDK grjups) received no special oral language 
stimulation treatment. These groups received merely one of the reading 
approaches a, an experimental treatment:. Groups 2, 5, and R (the one 
year PLDK groups) received, in addition to the experimental reading 
treatment, oral language stimulation for the first year of the project 
only, based on Level //I of the PIDK. Groups 3, 6, and 9 (the two year 
PLDK groups) received, in addition to the experimental reading treat- 
ment, two years of PLDK oral language stimulation exercises: Level //I 

during the first year of the project, and Level # 2 during the second 
year. Besides the nine experimental groups, a control group was 
established. Teachers and pupils in the control group (group 10) did 
not participate in any of the experimental treatments or incentives. 

The classes were only visited for pretesting, posttesting, and followup 
testing. In summary, the following 10 groups were, constituted: 

1) Group 1 - ITA followed by a basal reader without PLDK; 

2) Group 2 - ITA followed by a basal reader plus one y ear of PLDK; 

3) Group 3 - ITA followed by a basal reader plus two years of PLDK; 

4) Group 4 - WIC followed b> a basal reader without PLDK* 

5) Group 5 - WIC followed by a basal reader plus one year of PLDK; 

6) Group 6 - WIC followed by a basal reader plus two years of PLDK; 

7) Group 7 - SCRP without PLDK; 
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Method of Teaching Beginning Reading 
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Project , 



The basic research design for the Cooperative Reading 



8) Group 8 - SCRP plus one year of PLDK; 

9) Group 9 - SCRP plus two years of PLDK; 

10) Group 10 - Control group (no experimental treatments or incentives). 
Experimenta l Treatments 

Brief descriptions of the three initial reading approaches used in 
the project appear below. 



During the second year of the project, the school system found it 
necessary to combine certain classrooms. Thi 3 resulted in a change from 
three to two classes in tne WIC group which received one year of PLDK, as 
well as in the SCRP group which did not receive PLDK. This resulted in a 
loss of one class each for Groups b and 7. In the followup, third year 
the subjects were scattered throughout the schools with new teachers who 
had not been associated with the project. 
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1) Initial Teaching Alphabet . The Ear ly -to- Read series developed by 
Mazurkiewicz and Tanyzer (1963) was used as the experimental reading 
program. In contrast to the Downing Reading Series which utilizes a 
sight vocabulary approach, the Mazurkiewicz and Tanyzer program is based 
on the premise that children should first learn the individual sound 
symbols before being taught to synthesize them into words. Thus, a 
phonetic rather than a sight vocabulary approach was used. This emphasis 
appeared to hold special promise for Southern youth who frequently 
experience difficulty enunciating certain speech sounds. 

The ITA children moved from the Early - to -Read series into the Basic 
Reading series by McCtacken and Walcutt (1963). The children transferred 
into Book 2-1 which gives a systematic review of the phonic approach to 
beginning reading in TO. In the third, non-experimental year the ITA 
children were provided with the Reading- f or -Meaning series, published by 
Houghton Mifflin (McKee, Harrison, McCowen, & Lehr, 1963) and used 
generally in the Nashville Metro School System. 

2) Words -in -Color . The Words -in-Ceior program (Gattegno, 1963) 

is organized around a phonetic analysis of the English language as it is 
typically spoken. It utilizes color to facilitate the learning and 
recognition of the basic speech sounds used in reading. Under this 
system^ each of the 47 speech sounds of English identified by Gattegno is 
expressed by a specific color. Individual letters (or groups of letters) 
are colored according to how they sound in a given word. For example, 
the underlined portion of the following words would appear in the same 
color because they represent the same sound: la_te, w£y, waite, they, 

and str aight . In contrast, although the spelling is identical, the 
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underlined portion of the following words would be in a different color 
because each word represents a different speech sound: th ought , though, 

bough, and thr ough . 

The short sounds of the vowels are introduced first using colored 
chalk at the chalkboard. From the very beginning, the program stresses 
that the learner takes over the responsibility of producing the sounds 
associated with the signs. Until the pupils can vocalize the oral model 
accurately, the teacher is urged to give the auditory model, accompanied 
by the visual model. Therefore, the teacher supplies the visual model 
and the pupils vocalize its speech equivalent. The modeling is usually 
done with only one or two of the short vowel sounds. The teacher gives 
the children the opportunity to produce the remaining vowel-consonant 
combinations without vocal prompting. The WIG materials consist of 
colored phonic code wall charts, colored word building wall charts, work- 
sheets, a word building book, three pupil books, colcr-keyed word cards, 
and a book of stories. 

The program is basically designed to build word attack skills , It 
is supposed to be completed within a relatively short period of time, 
usually 12 weeks, with average and above average children. This initial 
period is then followed by any basal reading program. However, the 
teachers in WIC found that the program took much longer for their pupils 
to master than the literature suggested. Thus, the WIC teachers did not 
formally go into a specific basal reading program during the first year 
of the treatment. However, during the Spring, several levels of the 
Basic Read ing series by McCracken and Walcutt were placed in their rooms 
as supplementary materials. This reading series was continued into the 
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second year. The WIC pupils (like the other pupils) in the third, non- 
experitnental year moved into the regular program provided by the schools 
(i.e., the Houghton Mifflin Reading-for - Keanin g series). 

3) Supplemented Conventional Reading Program. The Supplemented 
Conventional Reading Program (SCRP) used a basal reading series supple- 
mented by a systematic phonics program. The basal program was the Reading - 
for - Meaning series by McKee, Harrison, McCowen, and Lehr (1963), 
published by Houghton Mifflin. This program was supplemented by the 
Reading with Phonics program, published by Lippincott, which is generally 
known as the Hay-Wingo phonic drills (1960) . 

The Houghton Mifflin Reading-f or -Meaning series is based on the 
premise that the typical English-speaking child brings to school a 
sizable speaking vocabulary, and that the major problem he encounters in 
beginning reading is finding a way to convert a printed word into its 
familiar spoken form. To accomplish this, a single technique is employed 
for unlocking new words. This consists of using both (1) the context of 
the sentence and (2) the beginning sound of the word. Some ending and 
middle sounds are introduced later in the program. At the pre-reading 
level, 18 single (one letter) consonants and four digraphs (sh, wh, th, 
ch) are taught. The other consonants and the vowels, plus common endings 
and other syllables, are introduced as they are needed. The basic vocab- 
ulary is carefully controlled. The teacher helps the children learn new 
words by using the program 1 s basic word-attack technique. The teacher T s 
guides which accompany each of the readers furnish (1) detailed lesson 
plans, (2) suggestions for meeting the needs of fast and slow learners, 

(3) and suggestions for the use of numerous supplementary materials 
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produced as a part of the program. 

Reading with Phonics by Hay and Wingo (1960) is not a basic reading 
program, but is a phonic skills program designed to develop independence 
in word attack skills. It makes the assumption, as does the Reading for 
Meaning program, that first grade children already have a large speaking 
vocabulary and need a word recognition program. The materials consist 
of one textbook and three workbooks. The phonic elements are learned 
through the auditory, visual, and kinesthetic sense modalities. The 
children are first taught to listen for a sound and then to associate the 
sound and its visual symbol. Kinesthetic development takes place in the 
correct movement of the tongue and eyes, and the development of hand and 
atm through writing (Hay & Wingo, 1960). 

In the third, non-experimental year the SCRP pupils continued on in 
the Houghton Mifflin Re a d in g-f o r -Mean in g series provided by the local 
school system. 

(Throughout all three years of the project the control subjects 
remained in the Reading - for -Meaning series by Houghton Mifflin.) 

A brief description of the oral language stimulation program 
appears below: 

(4) Peabody Language Development Kits . As already indicated, 

Levels //I and // 2 of the PLDK, developed by Dunn and Smith (1965, 1966) 
were used in this study. Level //I was designed for first grade and Level 
#2 for second grade disadvantaged children. The lessons were constructed 
to stimulate oral language and verbal intelligence, as well as to 
enhance school progress. Each of tha levels of the kits consisted of 
180 daily lessons — one for each day of a school year. The lessons 
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provided 30 to 35 minutes of well-planned daily oral language stimu- 
lation exercises. The philosophy of the program was that Language Time 
should be a half-hour interlude from conventional school work. Though 
early lessons required considerable teacher participation, the overall 
goal was to maximize the oral language behavior of the pupils in order 
to give them opportunities to talk, think, and learn effectively. 

Subjects 

At the onset of the CRP experiment, nine first grade classes were 
selected for each of the three reading treatments. (The ITA treatments 
were given at the same three schools whicn provided ITA instruction for 
the Cooperative Language Development Project . Three new schools were 
identified for each of the WIC and SCRP treatments.) This resulted in a 
total of 27 experimental classes with about 750 experimental subjects . 
Moreover, some 150 first graders were drawn from 12 classes in three schools 
to serve as control subjects. This gave a total initial pool of about 
900 pupils. At the onset of the project, complete pretest data were 
obtained on 838 subjects, 712 experimental and 126 control children. 

The original subject pool was reduced over the two-year treatment period 
due to some children being transferred out of experimental schools, and 
to other children not being available for posttesting and followup 
testing. At posttesting, 538 subjects — 473 experimental and 65 control 
subjects — constituted the posttest subject pool. This number had dropped 
to 354 — 306 experimental and 48 control subjects. (Approximately 80 per 
cent of the children were Negro, while the remaining subjects were 
Caucasian.) 
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Basic socioeconomic information , including the educational level 
of the best educated parent, housing conditions, and income level was 
obtained by rating on the Peabody Cultural Opportunity Scale (see 
Appendix A in Dunn, Pochanart, & Pfost, 1967.) These data confirmed 
that the project children came from disadvantaged backgrounds, Their 
families fell at the lower end of the socioeconomic continuum. On the 
basis of our socioeconomic status information, children were deleted from 
the final evaluation who came from families that: (1) the total family 

income was over $9,000, (2) lived in a very good house or apartment, 

(3) lived in a good house or apartment and the total family income was 
over $6,000, (4) the main wage earner was employed as a professional, 
technical, or a managerial worker, or (5) the best educated parent had 
four or more years of college training, 

T eachers 

Initially, 39 teachers participated in the study— 27 as experimental 
teachers rind 12 as control teachers. The teachers were selected by their 
principals on the basis of their availability and willingness to 
participate in the study. All the participating teachers in any one 
school were assigned to the same treatment. This was necessary to 
facilitate the administration and supervision of the project, as well as 
to provide an opportunity for the teachers to share ideas, Each teacher 
was required to keep her pupils for the two years of the experiment. Due 
to the partial closing of a school, one teacher in the SCRP treatment was 
placed in a school wh^re three teachers were in the WIC program, Moreover, 
during the second year, changes in teaching personnel occurred in one 
class in the SCRP plus one-year PLDK group, and in one class of the 







ITA plus one-year PLDK group. In addition, each of the WIC and SCRP 
treatments lost another teacher. Since the number of children in 
these classes had been reduced substantially at the end of the first 
year, the remaining children were absorbed into other rooms. These 
changes resulted In a total of nine ITA teachers, eight WIC teachers, 
and eight SCRP teachers for the second year of the project. 

Background data were collected on the original project teachers, 

Of the original 39 teachers, 21 had earned a B.A. degree, 17 had earned 
a M.A. degree, and there was one non-degree teacher in the SCRP plus 
PLDK treatment. The median total years of experience was seven or more 
years. There was only one teacher, in the SCRP treatment, who had no 
teaching experience. The median number of years for teaching first 
grade was four years, six months. Five of the original teachers in the 
project, however, were teaching first grade for the first time, Two of 
these teachers were in the ITA plus PLDK treatment, one in WIC, one in WIC 
plus PLDK, and one in the SCRP. 

To obtain ratings on overall effectiveness in teaching reading, 
three persons rated each of the teachers. All three were college 
instructors holding an earned doctorate with competence in reading 
instruction. These raters were not involved in the project in any other 
way than to rate the teachers. The median rating for the total group of 
teachers, on a five point scale, was average. Four teachers received a 
rating of poor: two in the ITA plus PLDK, one in the SCRP, and one in 

the control group. There were three teachers who received a rating of 
excellent: one each were in WIC plus PLDK, in SCRP without PLDK, and in 

the control group. Furthermore, four of the nine control teachers 
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received a rating of good and one of excellent. (Each of these latter 
teachers were members on the teaching staff of the only school in tne 
district that was accredited by the Southern Association of Colleges and 
Schools. This school and its personnel had met a set of criteria that had 
not been attained in any of the other schools participating in the project.) 
Supervision and Training of Teachers 

Initial training sessions for the teachers in all treatments were 
held during the first week in September, 1965. The PLDK , ITA, and 
treatments were all new to the teachers. The SCRP treatment materials 
were not so novel since the Houghton Mifflin Reading -for -Meaning series 
was already used in the schools, and some of the teachers had used the 
Hay-Wingo phonic drills. 

Each of the four treatments (PLDK, ITA, WIC, nd SCRP) had a con- 
sultant who handled the initial training, and visited the teachers in 
their treatment group throughout the year. The consultants also met 
twice a month with their teachers during each of the two years of the 
experiment (i.e,, 1964-65, and 1965-66). 

Teacher Incentives 

The experimental teachers were given a number of incentives not 
available to the control teachers. They were provided with small 
supplementary stipends and were asked to attend in-service training 
sessions throughout the year. Supplementary materials were purchased for 
the experimental teachers. They were visited frequently by the researchers 
and school officials. Furthermore, they were given considerable recog- 
nition by their principals and had an opportunity to observe each other 

teach. They were visited regularly by a consultant and were paired up in 
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schools to enable them to share informally their innovations and pro- 
blems, Thus, the experimental teachers knew they were being monitored, 
and motivation to excellence in teaching was high. In contrast, the 
control teachers were not given comparable stimulation or support. 

Their children were simply tested at the beginning of the experiment and 
retested at the end of each school year* Consequently, a very important 
part of the experimental treatment was the added incentives provided 
the experimental teachers for the first two years, but not to the 
control teachers. (During the tlird year, no additional incentives were 
available to the teachers of either the experimental or control subjects.) 
Evaluation Instruments 

Six measures were obtained to study pupil progress* They are 
described briefly belcw* 

1) Geneva! Intellectual Functioning * The 1960 Stanford - Mnet 
Intelligence Scale (Terman & Merill* 1960) was used to secure data on 
general intellectual functioning* The Stanford-Binet (S-B) is a 
standardised, individually administered intelligence scale yielding 
mental age and intelligence quotient scores. The test items range from 
the simple manipulation of objects to abstract reasoning* They arc 
grouped into age levels, in an ascending order of difficulty, ranging 
fro® age tvo to superior adult* 

2) Psycho Unguis tic Development * The I lllnols Test of Ps ycho- 
linguist lc Abilities (McCarthy & Kirk, 1961) was used to measure oral 
language functioning* It was administered by psychologists and psycho- 
metric technicians. This test (tTPA) was developed as an individual 
language test for children between the ages of tvo-and-»one*half and nine 
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years. The 1TPA consists of nine subtexts which measure two input 
channels (auditory and visual), two output channels (vocal and motor), 
and two levels of organization (representational and automatic-sequential) . 
Its major weakness as a followup test was its "lack of top." 

3) Creative Thinking . The Research Edition of T orrance Tes ts of 
Creat lve Thinking (Torrance, 1966) were used as a measure of creative 
thinking. This test battery has both verbal and flgural tasks. Only the 
first four Verbal Subtests of Fcrin A were administered in tho CRP 
evaluation. These four tests included the following activities: 

(a) The Ask and (kiesa Activity (Test Jl) — asking questions 
about a drawing. The questions are not answerable by merely looking 

l 

at the picture. 

(b) The Guess Causes Activity (Test #2) --making guesses about 
the causes of the event pictured, 

(c) The Guess Consequences Activity (Test #3)-- making guesses 
about the possible consequences of the event* 

(d) The Product Improvement Activity (Test #4) — producing ideas 
for improving a toy so that it will be more fun for children to 
play with. 

Although the norms exist on the Torrance Tests, raw scores were used 
in all statistical analyses. Three scores were obtained for the Verbal 
Subtests (fluency, flexibility and originality). These three test scores 
are defined as: 

(a) Verbal Fluency — ability to produce a large number of ideas 




with words. 
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(b) Verbal Flexibility-Lability to produce different types of 
ideas or strategies* 

(c) Originality — ability to produce ideas that are distinct 
from the obvious and commonplace . (Torrance maintains that subjects 
who achieve a high score on Verbal originality usually have a great 
deal of intellectual energy and may be rather nonconforming.) 

These thtee scores were averaged to provide the Verbal Subtest 

score used in the followup analyses* 

The Verbal Subtests of the T orrance Tests of Creative Thi nking were 
included because research has shown that they appear to be sensitive to 
the differential kinds of growth or change resulting from different 
teaching procedures, environmental conditions, etc. Moreover, they 
appear to be especially sensitive to one of the kinds of skills the 
Peabody Language Development Kits attempt to develop--namely divergent 
thinking (including brainstorming), 

4) School Achievement . The Metropolitan Achievement Test (MAT) was 
used to measure academic achievement. At the end of the third year, the 
written language portions of the Elementary Battery were administered 
(Durost, Bixler, Hildreth, Lund, & Wrightstone, 19^9). These consisted 
of the Word Knowledge (WK), Word Discrimination (WD) , Reading Comprehension 
(R) , Spelling (S), and Language (L) Subtests. Tbe achievement testing 
took place from late March to mid-May. Actual grade placement at time 
of testing averaged about 3.75 (aid-April) . All achievement testing was 
conducted by project personnel, not by the classroom teachers. 




5) Written Language Development . The Written Picture Story L anguag e 
Test (Myklebust, 1965) was used to assess written language abilities. The 
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children were asked to write a story about a picture. The writing 
samples were evaluated for: a) productivity, b) correctness, and 

c) meaning level or abstraction. Productivity was measured by computing 
the total number of words, total number of sentences and number of words 
per sentence. Grammatical correctness (or syntax) was evaluated by 
assessing accuracy in the use of word usage, word endings, and punctu- 
ation. Meaning (or level of abstraction) was treasured by means of an 
Abstract-Concrete Scale with score values ranging from zero to 25. (Only 
raw scores are reported in this paper,) 

6) Oral Language Development . An Oral ( Spoken) Pictu re S tory 
Languag e Test was designed by the project staff to parallel the Myklebust 
Written Picture Story Language Test . This test was also modeled somewhat 
after our earlier Pe abody Language Production Inventory (Nelson, 1964). 

A street scene involving a dog catcher, dog, and children was devised. 

Each child was asked to tell a story about the picture. The taped stories 
were transcribed and scored to yield raw score measures of a) productivity, 
and b) meaning level or abstraction. As in the Myklebust test, productivity 
was measured by computing the total number of words, total number of 
sentences, and number of words per sentence, leaning wa 9 assessed by 
means of an Abstract-Concrete Scale with score values ranging from tevc 
to 22 (it was not necessary to go as high as 25 to score our subjects). 

This test is a non-standard iced measure for which only r<*.v scores were 
available. 

Te3 1 Schedule 

The first year of the experiment was 1965-66 when the children were 
in grade cne. The second and final year of the experiment was 1966-67 
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when the children were in the second grade. The following year was 
1967-68 when the children were enrolled in the third grade. 

The pretesting was done in September, 1965 . The interim, post, and 
followup testing v*as completed during the Spring of the year, beginning 
in mid-March and terminating in early June. All testing was conducted by 
psychomet r J.c technicians working under the direction of psychological 
examiners , 

Analys is of Data 

As mentioned earlier, the results reported in this paper are 
primarily the followup statistics. Howevnr, some post and followup 
descriptive statistics are also presented (e.g., with the MAT), We 
presented certain of these descriptive statistics because our sample was 
reduced a little from posttesting to follcwup testing (from 403 to 354). 
However, the attrition of 54 subjects appeared to be distributed 
equally across all of the various treatment groups. Therefore, we had 
no reason to believe the descriptive and inferential statistics presented 
at the time of posttesting would not parallel this year 1 * posttest data, 
(The reader is referred back to our earlier monograph for the inferential 
statistics on posttest results.) The essential duplication of post- 
test descriptive statistics in this report is simply to facilitate the 
ability of the reader to compare the followup and posttest statistics. 

Analyses of variance were used to compare treatments among groups. 
Since there was an exploratory educational intervention study, the 0,90 
level of confidence was used throughout. To analyse significant main 
effects and interactions, t-testa were run when appropriate. 
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The data were analyzed in two different ways. First , a 3 x 3 <2 
factorial analysis of variance rfas used to contrast the three experimental 
reading programs in combination with the PIDi' treatments (see Figure 2). 
These comparisons will be referred to as the "reading groups" analyses. 
Second , a A x 2 analysis of variance was used to contrast the various 
PLDK experimental reading groups with the control group. It was assumed 
that type of experimental reading instruction would not effect markedly 
the success of the PLDK lessons. Therefore, the 1TA, WIC, and SCRP groups 
were collapsed for purpose of this se-ond analysis. (It was recognized 
that ITA plus PLDK had been more facilitating than ITA plus TO in the 
original CLDP study, but this was assumed due to the ITA being in an 
experimental program, while the TO children served as controls only.) 

This second inspection of the data is referred to as the "PLDK" analyses. 

The analysis of variance design for the reading groups analyses is 
illustrated in Figure 2, When pre-, post-, and follcwup-test scores were 
analyzed a3x3x3x2 mixed Type III extended analysis of variance was 
used (Lindquist, 1953). (This later design was used only on the Stanford- 
Binet k .1 ITPA analyses.) 

The PLDK 4x2 analysis is illustrated in Figure 3. When pre-, 
post-, and follc*.~up-test scores were analyzed, this became a 3 x 4 x 2 
mixed Type III analysis ot variance (Lindquist, 1953). (This latter design 
was used only in the Stanf ord-Binet and ITPA analyses.) 

Finding s at the End of the Experimental Period 

At the end of the two year experimental period of the CRP, when the 
children had completed the second grade, the following were the two major 
findings s 
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1 ) On written language achievement, the SCRP reading group was 
significantly superior to the ITA and WIC reading groups. In addition, 
there was some tendency for the 1TA group to be superior to the WIC 
group. Since the SCRP group received the most systematic phonic 
training program, the experiments! reading results appear to indicate 




A. (PLDK Treatments)* 

Fig. 2. Pictorial view of the analysis of variance design used to 
study experimental reading methods. 



*V/0 • experimental reading treatment without PtOR lessons; W/l * 
experimental reading treatment plus one year of PLDK lessons; V/2 * 
experimental reading treatment plus two years of PU.K lessons. 
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that the in:lusion of systematic training in these skills complements 
the materials of the basal reading programs vhen presented in traditional 
orthography. 

2) The exercises from the Peacody Language Development Kits facili- 
tated the development of certain linguistic skills as measured by the ITPA. 
Moreover , the PLDK lessons had a salutary effect upon the development of 
free, connected speech as measured by the Peabody Language Productio n 
Inventory . However, experience with PLDK did not appear to generalise to 
the area of academic achievement and intellectual development. In general, 
the results of this two-year intervention project did not give as opti- 
mistic a picture about the effectiveness of 1TA and PLDK as was demonstrated 
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A, (PLDK Treatments)* 



Fig. 3 Pictorial view for the analysis of variance design used to study 
the PLDK treatoents. 



*V/0 • experimental reading treat sent without PLDK lessons; V/) • 
experimental reading treatsent plu3 one. year of F1T>K lessons; M/2 * experi- 
mental reading treatsent plus two years of PLDK lessons. 
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in the earlier Cooperative Language Development Project , 

Data will now be presented on the status of the effectiveness of 
the interventions after the one-year followup period. 




Results and Discussion 
Characteristics of the Subjects 

The pretest characteristics of the selected sample of 354 subjects 
used in the third-grade, followup analysis are outlined in Table 1, 

These data describe the children when they entered the first grade--and 
the Cooperative Reading Project- -in the Fall, 1965. The subjects 
averaged 6-2 (73.92 months) in chronological age, 86.87 in Stanford- 
Binet IQ scores, and 5-2 (62,37 months) in language age on the Illinois 
Test of Psycholinguist ic Abilities , These descriptive statistics in 
Table 1 demonstrate that the treatment groups differed very little from 
each other on the three measures. This is confirmed in Table 2 which 
provides the analysis of variance data on these statistics. As will be 
seen, none \rf the differences was statistically significant. Thus, it 
was possible to use analysis cf variance in subsequent treatments of 
the data. 

I, The First Analysis (PLDK Treatments by Experimental Reading 
Approaches by Sex Differences) 

This aection examines the effectiveness cf both the PLDK treatments 
and the experimental reading intervention^. Too, it permits a look at 
differences in performance between boys and girls. What it docs not 
contain ate data on the control group. As will be seen in Figure 2, the 
basic research design was a 3 x 3 x 2 one. It was not possible to include 
a control group tn this balanced design, (Instead, most of the control 
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Sundry of ft et«*t D«r« on Selected Staple* by Treatment Croup 





CA 


IQ 


LA 


Treatment Croup N 


X s 


X s 


X s 



1TA without PLt* 



Boy* 


20 


73.40 


3.78 


88.25 


11.47 


63.40 


7.34 


Girl* 


20 


73.30 


4.35 


88.83 


9.43 


63.05 


8.12 


Total 


40 


73.33 


4.02 


88.35 


10.37 


63.22 


7. 64 


1TA with ooe year 
Boy* 


PLDtC 

20 


74.75 


3.32 


85.95 


8.42 


61.75 


9.01 


Girl* 


20 


74.20 


3.75 


83.40 


14.11 


59.30 


9.73 


Total 


<.0 


74.48 


3.51 


84.66 


11.34 


tO. 52 


9.34 


1TA with two year* 
Boy* 


PLDK 

20 


73.90 


4.99 


88.15 


9.83 


59.15 


7.87 


Girl* 


20 


72.55 


3.1/ 


85.75 


10.48 


63.75 


8.19 


Total 


40 


73.22 


4.18 


87.43 


10.05 


61.45 


8.26 


vie without run 


Boy* 


17 


74.47 


4.00 


86.82 


9.11 


61.82 


9.12 


Girl* 


17 


74.88 


3.89 


81.29 


10.09 


60. "1 


9.10 


Total 


34 


74.66 


3.89 


84.06 


9.87 


61.26 


8.99 


VIC with one yt*r 
Boy* 


Pit* 

17 


73,76 


3.63 


86.71 


12.31 


63.66 


8.47 


Girl* 


17 


72.94 


1.71 


89.35 


10.68 


63.76 


9.56 


Total * 


34 


73.35 


2.84 


88.03 


11.62 


63.82 


8.89 


VIC with two yttr* 
Boy* 


ru* 

17 


74.33 


3.97 


83.94 


8.50 


63.00 


8.16 


Girl* 


17 


74.59 


3.57 


87.00 


9.41 


65.71 


9.40 


Total 


34 


74.47 


3.72 


86.47 


8.63 


64.35 


8.78 


SCI? without ruxt 


Boy* 


14 


75.07 


3.43 


84.66 


8.89 


60.64 


5.65 


Girl* 


14 


74.57 


2.79 


93.37 


10.36 


65.50 


7.06 


Total 


21 


74.62 


3.09 


89.21 


10.46 


63.07 


6.74 


SCIf with toe year 
Boy* 


fit* 

14 


73.7? 


5.92 


88.21 


13.81 


63.29 


7.98 


Glrla 


14 


73.29 


6.09 


87.14 


8.62 


63.29 


6.74 


Total 


28 


73.50 


5.90 


87.68 


11.31 


64.29 


7.32 


SCW with two j*»r» FLtft 
lev* 14 


75.07 


5.21 


94.00 


9.11 


64.93 


8.78 


Girl* 


14 


73.71 


4.97 


83.21 


8.86 


61.43 


7.80 


Total 


28 


74.39 


5.04 


86.61 


10.39 


61.18 


8.34 


E*perie«nt*l Beading Total* 
1TA WO 


73.68 


3.92 


66.89 


1C. 71 


61.73 


8.45 


VIC 


102 


74.17 


3.33 


86.19 


10.21 


69.13 


8.90 


5 Ctr 


84 


74.24 


4.80 


88.50 


10.62 


63.51 


7.43 


tiMtiMoni m* 
Vlthout »U«. 


Totala 

102 


74.20 


3.77 


87.24 


10.38 


62.33 


7.87 


vith one year 


run 


102 


73.63 


4.12 


#6 .62 


11.50 


62.66 


8.77 


vith tvo year* 


FU* 


102 


73.96 


4.29 


87.44 


9.70 


62.89 


8.47 


Criftd Experimental 

Boy* 


Total 

133 


74.24 


4.21 


87.56 


10.29 


62.34 


8.10 


Girl* 


133 


73.75 


3.90 


81.63 


10.77 


63.05 


8.61 


Total 


304 


74.00 


4.06 


67.10 


10.33 


62.69 


8.33 


Ccnttol* 


toy* 


24 


11.75 


3.69 


61.60 


10.19 


60.50 


6.60 


Ctrl* 


24 


73.04 


3.56 


87.21 


10.27 


60.12 


6.0 


Total 


48 


73.40 


3.60 


81.60 


10.40 


60.31 


3.97 


Grand Total 


Sort 


177 


74.16 


•M3 


86.14 


10.26 


62.09 


7.12 


tlrti 


177 


13.66 


M5 


86.7* 


10.16 


62.63 


8.39 


total 


334 


73.92 


6.00 


86.67 


10.11 


62.37 


8.10 
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Table 2 

Analysis of Variance on Fretest Dali by Treatment Group 



Variable 


Source of 
Variat ion 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .95 


CA 


Between Groups 


9 


132.4660 


14.7180 


0.9190 


1.88 




Within Groups 


344 


5508.9920 


16.0140 








Total 


353 


5641.4577 








SB-1Q 


Between Groups 


9 


999.8600 


111.0960 


1.0058 


1.88 




Within Croups 


344 


37994.9400 


110.4500 








Total 


353 


38994.8000 








ITPA-LA 


Between Groups 


9 


784.3900 


87.1540 


) .3391 


1.88 




Within Groups 


344 


22388.2100 


65.0820 








Total 


353 


23172.6000 
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subject data are included in the second analysis later in this report.) 

Hie number of subjects involved in the experimental treatment was 306. 
(These 306 pupils plus the 48 controls yields the total of 354 subjects 
discussed in this total followup report*) Already presented in Tables 1 
and 2 were the pretest descriptive and influential statistics on all of 
these 354 subjects, Including the 306 pupils studied in this section of 
the report* Clearly, no differences in CA, IQ or LA existed among the 
various experimental groups at pretest time. 

Presented below are the statistics on pupil performance for the six 
measures listed and described earlier in this report* 

1) Intellectu al Functioning , The descriptive statistics on 

pretest, posttest, followup test data and gain IQ scores from the 
Stanford - Blnet intelligence Scale are reported in Table 3, In terms of 
overall experimental totals, the average IQ of the 306 subjects, upon 
entering school, was 87*10, By the end of the second gfa!c, their 
average IQ score had risen only 3.04 points to 90*14, By the end of the 
third grade the subjects had lost an average of 1*40 points and had a 
mean IQ score of 88.74. In terms ol these descriptive statistics, t ha 
gains and losses froa prc-, to post-, to followup testing appeared to be 
minimal. All of the experimental reading groups dropped slightly in IQ 
scores from post- to follcwup testing (-*90 for the 1TA, -1,76 for the 
WIC, and -1*69 for the SCRP groups) , The pattern for the PLDK treat- 
ment groups was similar. Froa post- to followup testing the ’without 
PLDK" group (W/0) dropped 1,38 IQ points, the "with one year PLDK" group 
(W/l) increased 0.11 IQ points, and the , Vith two years PLDK" group (V/2) 
decreased 2*95 points. These discouraging followup findings suggest the 
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Keans snd Stsndard Deviations on IQ St res an the Stanford-Binet lnr#l 1 1 g^ncr 
p r«t«st-, Pusttesr-, Follow-up-, Bid Galn-Scor« 



TreiLwnl Group 



>oiicv-up 



C>» t n. b 



ITA without PLDK 
Bay* 



20 

20 



SCRP with two years PLDK 



Beys 


14 


Girls 


14 


Total 
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Experimental Reading Totals 
ITA 120 



uic 

SCRP 



102 

£4 



Exp«rl*«rital PLDK Totals 
Without PLDK 102 

(V70> 

With on* year PLDK 102 

tW/1) 

With tv o y«ars PLDK i02 

(W/2) 

Grand E*p« rlocotal Total 

Boys 15) 



ClrlB 

Total 



15) 

3Q6 



O 

ERIC 



88,25 

11.47 

88.85 

9.4) 



Total 


40 


X 


08.35 






S 


10.37 


4 w 1 1 K one year PI OK 








Boys 


20 


X 


85.95 






s 


8.42 


Girls 


20 


X 


83.40 






s 


14.11 


Total 


40 


X 


84.68 






s 


LI. 54 


k with two years PLDK 








Boys 


20 


X 


89.15 






s 


9.83 


Clr Is 


20 


X 


86.7 5 






s 


10.40 


Total 


40 


X 


87.45 






s 


10.05 


; without PLDK 








ays 


17 


X 


86.62 






s 


9.11 


Girls 


17 


X 


81.29 






s 


10.09 


Total 


34 


X 


84,06 






s 


9.87 


l with one year PLDK 








Boy* 


17 


X 


86.71 






s 


12,51 


Girls 


17 


X 


89. 35 






s 


10.88 


Total 


34 


X 


88.03 






s 


11.62 


I with tv 3 years PLDK 








Boys 


17 


X 


85.94 






s 


8.50 


Girls 


17 


X 


87.00 






s 


9 .41 


Tot si 


34 


X 


86.47 






s 


8.85 


t? without PLDK 








Boys 


14 


X 


84.66 






s 


8.89 


Girls 


14 


X 


93,57 






s 


10. 36 


Tot si 


29 


X 


89.21 






s 


10.46 


U with one yetr 








Boys 


14 


X 


86.21 






s 


13.81 


Girls 


14 


X 


87.14 






s 


8.62 


Total 


28 


X 


B 1 



92.00 
12.27 
89.55 
13.64 
90.68 
12. B? 



87.55 

10.24 

84.00 
15. U 
85.78 

33.0 1 



88.30 
13.60 

80.30 
11.84 

88.30 
12.59 



89.71 
14. 17 
85.47 
14 .P‘4 
B7.59 
14.45 



90.71 

17.17 

92.35 

12.31 

91.53 

14.73 



89.82 
12.49 
92.06 
13.67 
90,94 
17 .94 



93.07 
13.36 

92.07 
13.52 
92.57 
13.20 



90.29 
13.22 
0.-.4 3 
.29 
'1.38 
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R9.60 

11.87 

60.25 

13.90 

88.92 

12.73 



90.00 

13.05 

85.00 
lh.74 
87.50 
15.03 



85.55 

11.39 

85.70 

10.07 

85.62 

10.61 



87.41 
12.23 
85.35 
12.67 
86. 38 

12.41 



89.06 
15.61 
93.24 
14.69 
91.16 
IS. 27 



88.76 
13.93 

85.76 
10.81 
87.26 
12.37 



91.79 

11.28 

91.29 

12.62 

91.54 

11.75 



89.00 

13.31 

90.57 

11.68 

09.78 

32.40 



94.21 
7.16 

91.00 

12.64 

92.61 

10.21 



87.35 
12.89 
88. 2f 
13.45 
91.31 
11.41 



68.79 

12.42 

89.34 

14.39 
88.09 

11.39 



69.29 

12.38 

68.19 

13.15 

88.74 

12.76 



1.75 


1.35 


-2,40 


0.50 


- 0.60 


-1,1'J 


2.13 


0,37 


-1.76 


1.60 


4.05 


2. .5 


0.60 


1 .60 


1.00 


L. 10 


2.82 


1.72 


0.15 


-2.60 


-2.75 


1.55 


-1.05 


-2.60 


0.85 


-1.83 


-2.63 


2 . SR 


0.59 


-2. 29 


4,19 


4 .06 


-0.12 


3.5J 


2.3? 


-1,21 


4.00 


2 . 36 


-J .64 


3.00 


3.89 


0.69 


3.50 


3.12 


-0 . J8 


3.88 


2.82 


-1.06 


5.06 


-1.24 


-6.30 


4.47 


0.79 


-3.60 


8.21 


6.92 


-1,29 


-1.50 


-2.29 


-0, 79 


3.36 


2.3* 


-1.03 


2.07 


0,79 


-1.28 


5.29 


3.43 


-1.06 


3.66 


2.10 


-1.58 


4.9) 


0,21 


-4.72 


9.00 


7.79 


-0.21 


6.46 


4.00 


-2.46 


1.16 


0.46 


-0.90 


3.03 


«.0 7 


-1.76 


4.50 


2.01 


-1.69 


2.9) 


1.55 


-1.39 


2.61 


2.72 


0.11 


)„ 60 


0.65 


-2.95 


3.31 


1.73 


-1.50 


2.79 


1,56 


-1.2) 


3. 04 


1.64 


-1.40 



‘Poattast *ln us pretest IQ. 
^Follow-up teat sinus pretest IQ. 
c follcv-wp test sinus postteit IQ. 



probability that the children had a very non-stimulating year in the 
third grade. 

The analysis of variance data in Table 4 reveal no significant "PLDK 
treatment" main effect. However, there was a significant main effect on 
the "Reading Method" dimension. There was also a significant main effect 
over Test Years. The t-test analyses revealed that the overall IQ 
scores for the SCRP group were sign! f icantly above both the 1TA and WIC 
groups. This breakdown also revealed the discouraging finding that, v/hile 
there was a significant IQ score increase from pre- to post-testing, no 
significant differences existed between pre- and followup IQ test scores. 

In other words , what intellec tual stimulation the children had received 
during their firs t two years of school was lost in their third grade . 
Apparently, progressive intellectual deterioration had already set in for 
these children of poverty. 

Table 4 also indicates the presence of a significant interaction 
among Test Years by PLDK by Reading Method by Sex variables (A x B x C x D) . 
This effect is next to impossible to unscramble. But, generally, nothing 
clearcut in terms of our predicted results is discernable from the morass 
of _t-tests we broke down and examined relative to this complex statistical 
phenomenon. All three WIC groups — W/0, W/l and W/2 — gained significantly 
in IQ scores from pre- to post-test. In many cases, the SCRP groups also 
gained significantly from pre- to post-test. However, the ITA groups 
failed to make significant IQ gains. Even after losses in the third grade, 
the followup IQ scores of many of the WIC and SCRP groups were signifi- 
cantly higher than at pretesting. Finally, the total WIC reading group 
and the WIC girls with two years of PLDK decreased significantly in IQ 
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Analysis of Variance on IQ scores of the S tanf ord-Btnet 
Intelligence Scale 

Pretest, Posttest, and Follow-up Scores 



Source of 


Degrees of 


Sum of 


Mean 






Variation 


Freedom 


Squares 


Square 


F Ratio 


F 

t .90 



Between Subjects 305 

B (PLDK) 2 

C (Reading Method) 2 
D (Sex) 1 

B x C 4 

B x D 2 

C x D 2 

B x C x D 4 

Error (b) 288 

Within Subjects 612 

A (Test Years) 2 

A x B 4 

A x C 4 

] 

I A x D 2 

j A x B x C 8 

A x B x D 4 

| A x C x D 4 

AxBxCxD 8 

l Error (w) 576 



11.1919 .0000 


366.9480 






34.8000 


17.4000 


0.0473 


2.30 


1870.2000 


935.1000 


2.5439* 


2.30 


399 . 3000 


309.3000 


0.8414 


2.71 


1858.3000 


464.5750 


1.2639 


1.94 


131.1000 


65.5500 


0.1783 


2.30 


84.2000 


42.1000 


0.1145 


2.30 


1767.1000 


441.7750 


1.2018 


1.94 


105864.0000 


367.5830 






278^4.8000 


45.4980 






1422.3000 


711.1500 


16.6155*** 


2.30 


251.0000 


62.7500 


1.4661 


1.94 


311.3000 


77.8250 


1.8183 


1.94 


10.6000 


5 . 3000 


0.1238 


2.30 


238.2000 


29.7750 


0.6957 


1.67 


193.8000 


48.4500 


1.1320 


1.94 


35.7000 


8.9250 


0.2085 


1.94 


728.9000 


91.1130 


2.1288** 


1.67 


24653.0000 


42.8000 






139763.8000 









Total 



917 



O 

ERIC 



*p <.10 

**p <.05 

***p <.01 
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scores from post- to followup testing. 

In light of these statistical analyses of IQ scores, the following 
conclusions are drawn: 

a) At time of posttesting, the PLDK exercises did not lead to 
differentials in IQ scores. It is not surprising that this finding 
continued into the followup analysis. In this Cooperative Reading 
Pro j ect , one must conclude that the PLDK Lessons did not raise IQ 
scores appreciably. 

b) Overall, the SCRP group had higher IQ scores over the three 
testings than the ITA or WIC groups. Furthermore, the total W1C 
reading group decreased significantly in IQ scores from post- to 
f ollowup testing. 

c) While IQ scores had increased significantly from pre- to post- 
testing, an unanticipated, and shocking finding of this study was 
that these scores had fallen back to the initial level by the time 

of followup testing. It would appear what intellectual stimulation 
the children had received during their first two (experimental) 
years In school was lost in the third grade. 

2) Psycholinguis tic Development . The descriptive pre-, post-, and 
followup test data for language age (LA) in months on the Illinois Test 
of Psycholinguis tic Abilities appear in Table 5. In terms of grand 
experimental totals, the 306 subjects gained 18.42 months in language 
during their first two years in school for an average of 9.21 months per 
year. During their third year in school they Increased 8.53 months, for 
a total of 26.95 months In LA from pre- to followup testing — a time span 
of some 32 months* In terms of differences across PLDK groups, the gains 
q ' com pre- to followup testing were fairly even, with the largest (27.93) 
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***** aud Standard Davlatlo na on U Scoraa of tha IllLnola Taat of Pay chollngulatlc Abllftlrt: 
Prataat-, Poattaat-, Follow-up-, and GaLn-Scorta 



O 

ERIC 



Traatnant Group V Pra Poat follow-up Gain* Cain* Caln c 



ITA without PLDK 



Boy* 


20 


X 


63.40 






s 


7.34 


Ctrl* 


20 


X 


63.05 






s 


8.12 


Vocal 


■ 10 


X 


63.22 






s 


7.64 


It* with oca fair Pint 








Boy a 


20 


X 


61.75 






s 


9.01 


Clrla 


20 


X 


59.30 






s 


9.73 


Total 


40 


X 


60.52 






s 


9.34 


ITA with two yaara PLDK 








Boya 


20 


I 


59,15 






s 


7.87 


Clrla 


20 


X 


63.75 






s 


B. 19 


Total 


40 


I 


61.45 






5 


ft. 26 


W1C without PLDK 








Soya 


17 


i 


41. « 






s 


9.12 


Clrla 


17 


I 


60.71 






s 


9.10 


Total 


34 


! 


61.26 






s 


1.99 


W1C with ooa y«ar PL& 








Boya 


17 


X 


IMS 






s 


a. 47 


Clrla 


17 


i 


63.76 






s 


9.56 


Total 


14 


I 


63. B2 






9 


1.69 


VIC with two yaara PLDK 








Boya 


17 


( 


63.00 






B 


8.16 


Clrla 


17 


X 


65.71 






» 


9.40 


Tfttal 


34 


s 


64.35 






s 


8.78 


SCKP without PLDK 








Boya 


14 


X 


60.64 






s 


5.65 


Clrla 


14 


X 


65.50 






s 


7.06 


Total 


28 


X 


63.07 






s 


(.74 


STL? with on* ytar PLDK 








Boya 


14 


X 


63.29 






s 


7.9B 


Clrla 


14 


X 


65.29 






s 


6.74 


Total 


28 


X 


64.29 






s 


7.32 


SOP with two yaara PLDK 








loya 


14 


X 


64.93 






s 


8.78 


Clrla 


14 


X 


61.43 






s 


7.80 


Total 


28 


I 


63.18 






s 


8.34 


r KparlneDtal Kaadisp Total# 






ITA 


120 


1 


61.73 






s 


8.45 


VIC 


102 


X 


63.15 






s 


8.90 


sen? 


84 


X 


6) M 






s 


7.43 


Experimental PLDK Tot a la 








Without PL» 


102 


X 


62.53 


<V/0) 




$ 


7.87 


With <«a yaar PLDK 


102 


X 


62.66 


(V/l) 




s 


8.77 


With two yaara PLDK 


102 


X 


62.89 


(V/2) 




s 


8.47 


Grand Eapa. imantal Total 








loya 


m 


X 


62.34 




s 


8.10 


Clrla 


IS) 


X 


63.05 






ft 


8.61 


Total 


>06 


X 


62.69 






1 


8.35 



79. V5 
9.66 


91.80 

12.02 


16.35 


2 1.40 


12.05 


BO. 15 
12.87 


91.65 

13.15 


17.10 


28.60 


11.50 


79.95 
11 .23 


91.72 

12.43 


16.73 


28.50 


11.77 



82.25 
12. ** 


92.45 

12.54 


20.50 


30.70 


10.20 


76.80 

12.81 


84.40 
15 05 


17. 50 


25.10 


7.60 


79.52 

12.56 


88.42 

14.27 


19.00 


2 7.90 


8.90 



79.30 

10.66 


86.50 

12.64 


20.15 


27.35 


7.20 


77.00 

7.59 


85.30 

9.62 


13.25 


21.55 


8.30 


78.15 

9.21 


85.90 

11.10 


16.70 


24.45 


7.75 



79.24 


84.12 


17.4? 


27. 30 


4.88 


14.27 


10.95 








75.18 


84.18 


14.47 


23.47 


9.00 


10.33 


10.85 








77.21 


84.15 


15.95 


2 7.69 


6 .94 


12.44 


10.71 









81.06 

12.12 


91.65 

13.22 


17.18 


27.77 


10.59 


79.53 

9.78 


94.35 

12.08 


15.77 


10.59 


14. B2 


80.29 

10.87 


93.00 

12.54 


16.47 


29.18 


12.71 



84.94 

8.00 


91.88 

11.43 


21.94 


28.68 


6,94 


82. B8 
12.77 


90.82 

12.20 


17.17 


25.11 


7.94 


83.91 

10.55 


91.35 

11.65 


19.56 


27.00 


7.44 



83.36 

9.09 


89.07 

8.81 


22.72 


28.63 


5.71 


86,07 

11.85 


M « 

o o 


20.57 


24. 86 


6.29 


84.71 

10.46 


89.71 

9.61 


21.64 


26.64 


5.00 



83.14 

10.44 


89.29 

12.77 


19.85 


?6.00 


6.15 


86.43 

11.09 


92.21 

12.81 


21.14 


26.92 


5.78 


64.79 

10.70 


90.75 

12.64 


20.50 


26.46 


5.96 



86.57 

10.46 


96.79 

11.17 


21.64 


31.86 


90.22 


82.07 

10.79 


89.36 

11.08 


20.64 


27.93 


7.29 


64.32 

10.68 


91.07 

11.56 


21.14 


29.89 


8. 73 



79.21 

11.02 


88.68 

12.79 


17.48 


26.95 


9.47 


80.47 

21.54 


89.50 

12.18 


17.32 


26.35 


9.01 


84.61 

10.48 


91.18 

11.29 


21.10 


27.67 


6.57 



80.34 


88.65 


17.81 


24. 12 


8.31 


11.71 


11.53 








81.23 


90.59 


18.57 


2 7.91 


9.36 


11.62 


13.29 








81.76 


89.69 


18. B7 


26.80 


7.93 


10.40 


11.72 








81.95 


90.31 


19.61 


27.97 


8.36 


10.91 


12.06 








80.27 


88.9 7 


17.22 


25.92 


8.70 


11.53 


12.33 








81.11 


89.64 


18.42 


26.95 


8.53 


11.24 


12.19 









•poattaat aUui prataat IQ. 
•follow-up taat ainua prataat IQ. 
‘follow-up tMt miA« poottaat IQ. 
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being for the W/l group, the next being 26.80 for the W/2 group, ani the 
lea^t being 26.12 for the W/0 group. In terms of experimental reading 
totals, the SCRP gained the most with 27.67, the ITA next with 26.95, and 
the WIC least with 26.35 months. In terms of sex differences, girls 
gained only 25.92 while the boys gained 27.97 months. 

The analysis of variance data on these LA scores appears in Table 6. 
There was not a significant main effect on the PLDK variable. However, 
there was a main effect difference on the "reading method" dimension. 

The t_-test breakdown revealed the SCRP group superior to the WIC and ITA 
groups . 

There was no significant main effect on the sex dimension. 

On the "Test Years" variable, there was a significant main effect. 

The children, as a total experimental group, gained significantly in LA 
from pre- to post-testing, and from post- to followup testing. A larger 
LA gain occurred between pre- to post-testing, than from post- to follow- 
up testing — which was anticipated since two years growth was being com- 
pared with one year of growth. 

There were a number of Interactions which were statistically signifi- 
cant, but probably educationally unimportant. There were significant PLDK 
by Reading Method (B x C), Test Years by Reading Method (A x C) , Test 
Years by Sex (A x D) , and a significant Test Years by PLDK treatment by 
Reading Method triple interaction (A x B x C) . All but the A x D inter- 
action are explained by this triple interaction. 

Upon posttesting, the WIC and SCRP groups attained slightly greater 
LA gains than the ITA group In combination with two years of PLDK exer- 
cises. Similarly, the WIC and SCRP with two years of PLDK exercises (W/2) 
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Analysis of Variance on LA Scores of the Illinois 



lost of Psychol inguis t i c Abilities 
Pretest, Posttest, and Follow-up Scores 



Source of 
Variat ion 


Degrees of 
Freedom 


= Sum of 
Squares 


Mean 

Square 


F Ratio 


1 90 


Between Subjects 


305 


80494.9000 


263.9180 






B (PLDK) 


2 


189.1000 


94.5500 


0.3653 


2.30 


C (Reading Method) 2 


1546.4000 


773.2000 


2,9870* 


2.30 


D (Sex) 


1 


134. 7000 


134. 7000 


0 . 5204 


2.71 


B x C 


4 


2383.7000 


595.9250 


2 . 3022* 


1.94 


B x D 


2 


114.2000 


57.1000 


0,2206 


2.30 


C x D 


2 


134.3000 


67.1500 


0 . 2394 


2.30 


B ;c C x D 


4 


1442.2000 


360.5500 


1. 3929 


1.94 


Error (b) 


288 


74550.3000 


258.8550 






Within Subjects 


612 


140703.7000 


229.9080 






A (Test Years) 


2 


116092.6000 


58046.3000 


1494.9349*** 


2. 30 


A x B 


4 


115.1000 


28.7750 


0 .7411 


1.9'. 


A x C 


4 


455.0000 


113.7500 


2.9295** 


1.94 


A x D 


2 


253.3000 


126.6500 


3.2618** 


2.30 


A x B x C 


8 


868.6000 


108.5750 


2.7963*** 


1.67 


A x B x D 


4 


149.0000 


37.2500 


0.959 3 


1.94 


A x C x D 


4 


198. 3000 


49.5750 


1.2768 


1.94 


A x B x C x D 


8 


206.5000 


25.8130 


0.6648 


1.67 


Error (w) 


576 


22365.3000 


38.8290 






Total 


917 


221198.6000 


241.2200 








*p <.10 

**p <.05 

***p <.01 
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made greater LA gains from pre- to followup testing than the 1TA group with 
two years of such lessons (W/2) * However, the ITA and SCRP groups made 
greater LA gains than the WIC group from pre- to followup testing only 
among children who did not receive the PLDK exercises. The WIC with two 
years of PLDK exercises made greater progress than the WIC without PLDK 
exercises (W/0) from pre- to post-testing, as well as from pretest to 
followup evaluation. However, the ITA without PLDK exervises (W/0) made 
greater gains than the ITA group with two years of PLDK lessons. 

The following conclusions are drawn from the language age scores on 
the ITPA: 

a) Generally, the PLDK lessons did not prove effective in 
raising LA scores on the ITPA. 

b) Overall, the SCRP children gained more in language age 
than either the WIC or the ITA treatment groups. 

c) There were no differences, overall, between boys and girls 
on language age gains . 

3) Creative Thinking . Followup scores on the total verbal subtests 
of the Torrance Test s of Creative Thinking are reported in Table 7. 
Examination of the mean raw score values in Table 7 will reveal a gradual 
increment in mean values from 73.62 for the children in experimental 
reading programs without PLDK (W/0), to 84.27 for those with one year 
of PLDK (W/l), to 86.72 for those with two years of PLDK (W/2) . In 
terms of the reading treatments the SCRP group was the highest with a 
mean of 85.88, ITA second with a mean of 85.40, and WIC with a mean of 
72,59. The girls were slightly higher than the boys 81.77 vs. 81.30). 

The question remains: which, if any, of the differences were 

statistically significant? 




Table 7 



35 



Keans and Standard Deviations on Total Verbal Subtest Scores 



f 

I 




of the Torrance Teet9 


of Creativity 




Treatment Group 


!< 


X 


s 


ITA without PLDK 


Boya 


20 


74.10 


29.13 


Girls 


20 


77.65 


32.87 


Total 


/*o 


75.88 


30.70 


ITA with one year PLDK 


Boys 


20 


88.95 


23.67 


Girls 


20 


92.05 


26.98 


Total 


40 


90.50 


25.10 


ITA with two years PLDK 


Boys 


20 


86.95 


28.09 


Girls 


?0 


92.70 


, 38.46 
33.37 


Total 


40 


89.82 


VIC without PLDK 


Boys 


1.7 


76.53 


20.50 


Girls 


17 


58.35 


19.90 


Total 


34 


67.44 


21.93 


VIC with one year PLDK 


Boys 


17 


71.88 


15.93 


Girls 


17 


79.82 


27.75 


Total 


34 


75.85 


22.64 


VIC with two years PLDK 


Boys 


17 


67.29 


27.61 


Givis 


17 


81.65 


23.07 


Total 


34 


74.47 


26.09 


SCRP without PLDK 


Boy9 


14 


83.86 


17.95 


Girls 


14 


71.93 


27.14 


Total 


28 


77.89 


23.38 


SCRP with one year PLDK 


Boys 


14 


89.93 


22.30 


Girls 


14 


81.29 


30.58 


Total 


28 


85.61 


26.63 


SCRP with two years PLDK 


Boys 


14 


95.64 


42.58 


Girls 


14 


98.64 


31.57 


Total 


28 


97.14 


36.82 


Experimental Reading Totals 


ITA 


120 


85.40 


30.43 


VIC 


102 


72.59 


23.68 


SCRP 


84 


86.88 


30.21 


Experimental PLDK Totals 


Without PLDK 


102 


73.62 


26.21 


With one year PLDK 


102 


84.27 


25.30 


With two years PLDK 


102 


86.72 


33.15 


Grand Experimental Total 


Boya 


153 


81.30 


27.03 


Glrla 


153 


81.77 


30.77 


Total 


306 


81. 54 


28.91 
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Analysis of variance data of the Torrance Tests appear in Table 8. 
Significant main effects were obtained on levels of PLDK, as well as on 
methods of teaching beginning reading, but not on the sex dimension. There 
were no significant interactions. The t-test breakdown on levels of 
PLDK treatment revealed that both the W/l and W/2 PLDK groups were 
significantly superior to the W/0 PLDK group, but no significant 
difference was obtained between W/l and W/2, In terms of the reading treat- 
ments, ITA and SCRP were superior to WIC, but no significant difference 
was found between the ITA and SCRP groups. 

The following conclusions are drawn for the analyses of the total 
verbal subtests scores on the Torrance Tests of Creativ e Thi nking : 

a) One or two years of PLDK exercises resulted in higher 
verbal performance on the Torrance Tests of Creative Thinking 
than no PLDK training, 

b) One year of PLDK exercises was as effective as two years 
ir stimulating verbal creativity scores. 

c) Both the ITA and SCRP groups were superior to the WIC group 
in creativity scores, with no explanation proposed for this 
unanticipated result except that of teacher and/or pupil selection, 

4) School Achievement . Grade equivalent scores on the Metropolitan 

Achievement Tests (MAT) are presented in Table 9 and raw scores in 
Table 10. The scores were derived from the five written language subtests: 
a) Word Knowledge, b) Word Discrimination, c) Reading Comprehension, 

d) Spelling, and e) Language, The total score was obtained by averaging 
these five subtests together. Examination of Table 9 will reveal that, 
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Table 8 

Analysis of Variance on Total Verbal Subtest Scores 
of the Torrance Tests of Creative Thinking 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A (PLDK) 


2 


3896.9000 


4948.4500 


6.3826* 


2.30 


B (Reading Methods) 2 


12357.7000 


6178.8500 


7.9695* 


2.30 


C (Sex) 


i 


17.0000 


17.0000 


0.0219 


2.71 


A x B 


4 


2195.3000 


548.8250 


0.7079 


1.94 


A x C 


9 


3224.1000 


1612.0500 


2.0792 


2.30 


B x C 


2 


1263.9000 


631.9500 


0.8151 


2.30 


A x B x C 


4 


2724.8000 


681.2000 


0.8786 


1.94 


Error 


288 


223288.5000 


775.3070 






Total 


305 


254968.2000 








*p < .01 












on the average, 


the 306 experimental subjects 


were achieving at the 


> 2.67 


grade level i i ; 


March or April 


of their second 


year in school, and had only 


increased to 2.77 during their 


third year in 


school. (This small increment 


of 0.10 of a grade in a full year is alarming. Even though the mean pre- 


test IQ of the 


group was only 


87.10 (see Table 3), much 


more progress than 


this could be anticipated. If 


the MAT data are valid and reliable, 


, this 


is sad commentary on the third 


grade teachers. However, 


, it must be pointed 



out that the Primary II Battery was given after the second grade, and 
the Elementary Battery after the third grade. (This latter battery may 



O 




3b 



have been too advanced for these pupils, or the standardization may have 

i 

been enough different to make the small increment an artifact of the 
different test batteries.) Children in the experimental reading programs 
without PLDK were achieving, on the average, at the 2.77 grade level at 
posttesting, and at the 2.90 grade level at time of the followup evalu- 
ation. The W/l group were at the 2.50 grade le^el at posttesting and 
2.70 at followup. The W/2 group were at 2*73 posttesting and 2.71 at 
followup. In terms of the experimental reading groups, the ITA group was 
at the 2.61 grade level at posttesting and 2.75 at followup. The WIC 
group were at 2.49 at posttesting and 2.71 at followup. The SCRP group 
were at 2.96 at posttesting and 2.87 at followup. (Also included in 
Table 9 and 10 are descriptive data on the control group, even though 
these data were not included in the analyses of variance.) 

The analysis of variance statistics on the followup data are 
reported in Table 11 for total written language raw scores. The findings 
had changed from last year when tue SCRP reading group was superior to 
both the ITA and WIC groups (see pages 20 - 23). At time of followup, no 
significant main effect difference remained across experimental reading 
treatments, (The descriptive data in Table 9 reveal that the SCRP group 
slipped from a grade equivalent of 2.96 to 2,87 at time of followup., 
while both the ITA and WIC groups made slight gains.) Furthermore, 
there were no significant differences across PLDK treatments. As expected, 
the girls were achieving significantly above the boys. The significant 
PLDK by sex interaction was due primarily to the girls in the W/0 group 
achieving significantly above those in the W/l and W/2 groups Finally, 
the girls were only significantly superior to the boys within the W/0 
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Table 11 

Analysis of Variance on Total Follow-up Written Language Subteat Raw 
Scores of the Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F 

r .90 


A (rLDK) 


2 


5114.3000 


2557.1500 


1.9040 


2.30 


B (Reading Methods) 2 


2428.3000 


1214.1500 


0.9040 


2.30 


C (Sex) 


1 


14659 .9000 


14659 .9000 


10.9152** 


2.71 


A x B 


4 


10337.4000 


2 5b 4. 3500 


1.9242 


94 


A x C 


2 


7525.5000 


3762.7500 


2.8016* 


2,30 


B x C 


2 


3973.8i)00 


1986.9000 


1.4794 


2.30 


A x B x C 


4 


6984.4000 


1746.1000 


1.3001 


1.94 


Error 


288 


386804.5000 


1343.0710 






Total 


305 


437828.1000 









*p <.10 
**p <.01 



group, suggesting nildly that the PLD>. is an equalizer to bring the boys 
up to the girls' standards. 

In Tables 12 through 16 are the analyses of variance statistics for 
each of the five written language eubtests of the HAT. In light of the 
inconsequential overall written language gains nade by the subjects in 
each of the groups during their third year in school (see Table 9), the 
results of these subteats will not be discussed in detail. However, the 

tables are Included in the report for those who nay wish to give thoa 

O 
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'fable 12 

Analysis of Variance on the Follow-up Word Knowledge Subtests 
Raw Scores of the Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A (PIDK) 


2 


87.4300 


43.7150 


0.5440 


2.30 


B (Reading Methods) 2 


396.6030 


198.3020 


2.4677* 


2.30 


C (Sex) 


1 


56.9410 


56.9410 


0.7086 


2.71 


A x B 


4 


630.8210 


157.7050 


1.9625* 


1.94 


A x C 


2 


252.9580 


126.4790 


1.5739 


2.30 


B x C 


2 


96.7950 


48.3980 


0.6023 


2.30 


A x B x C 


4 


285.1220 


71.2810 


0.8870 


1.94 


Error 


288 


23143.5720 


80.3600 






Total 


305 


24950.2360 









*p <.10 



more intensive study. The main subtest results are discussed briefly 
below: 

a) Significant differences among PIDK groups were obtained on two 
of the five subtests, namely, Reading Comprehension and Language. The 
differences on both subtests resulted from the superior performance of 
the non-PLDK group In comparison to those with one and two years of PLDK. 

b) Significant differences among the experimental reading treat- 
ments were obtained on two of the five sub tea tv , namely Word Knowledge 

and Spelling. On both the Word Knew ledge and Spelling Subtests, the SCRF 

O 
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Table 13 

Analysis of Variance on the Follow-up Word Discrimination Subtest 
Raw Scores of the Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A (PLDK) 


2 


102.1240 


51.0620 


0.9308 


2.30 


B (Reading Methods) 2 


84.8650 


42.4330 


0.7735 


2.30 


0 (Sex) 


1 


494.5130 


494.5130 


9.0147** 


2.71 


A x B 


4 


314.1860 


78.5470 


1.4319 


1.94 


A X C 


2 


354.3940 


177.i970 


3.2302* 


2.30 


B x C 


2 


383.3740 


191.6870 


3.4943* 


2.30 


A x B x C 


4 


135.4380 


33.8600 


0.6172 


1.94 


Error 


288 


15798.6140 


54.8560 






Total 


305 


17667.5070 









*p <.05 

**p <.01 



group was superior to both the 1TA and WtC groups, but no significant 
differences were obtained between the latter two groups. 

c) Significant differences between boys and girls were obtained on 
four out of fivt subtests. The girls obtained higher scores than the 
boys on all the MAT Subtests with the exception of Word Knowledge. These 
data support the repeatedly discovered finding that girla do better than 




boys in school achievement in the elementary grade*. 

a 

d) Significant interactions between Sex end Experimental Reading 
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Table 14 

Analysis of Variance on the Follow-up Reading Comprehension Subtest 
Raw Scores of the Metropolitan Achievement Testa 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Me tin 
Square 


F Ratio 


F .90 


A (PLDK) 


2 


183.7310 


91.8660 


2.5545* 


2.30 


B (Reading Methods) 2 


110.9820 


55.4910 


1.5431 


2.30 


C (Sex) 


1 


515.0620 


515.0620 


14.3226*** 


2.71 


A x B 


4 


462.2990 


115.5750 


3.2138** 


1.94 


A x C 


2 


356.7490 


178.3750 


4.9601*** 


2.30 


B x C 


2 


48.9650 


24.4830 


0.6808 


2.30 


A x B x C 


4 


218.2910 


54.5730 


1.5175 


1.94 


Error 


288 


10356.9200 


35.9620 






Total 


505 


12252.9970 









*p <.10 

**p <.05 
***p <.C1 



Methods were obtained on the Word Discrimination and Spelling Subteste. 
In both cases, boys achieved better under SCRP than under WlC, with a 
trend for SCRP to be superior also to ITA, while 1TA was superior to 
W1C. For girls, there was a trend for W1C to be better than ITA. 

e) Significant PLDR by Sex interactions were obtained on the fcord 
Discrimination, Reading, and Spelling Subtests. For girls only, V/O 
was superior to both W/l and W/2j the W/l and W fi groups were approxi- 
mately equal. 
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Table 15 

Analysis of Variance on the Follow-up Spelling Subtest Raw Scores of the 

Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sun of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A (PLDK) 


2 


278.4890 


139.2450 


1.1313 


2.30 


B (Reading Methods) 2 


813.4160 


406.7080 


3.3045** 


2.30 


C (Sex) 


1 


1453.8860 


1453.8860 


11.8127*** 


2.71 


A x B 


4 


G60.9890 


215.2470 


1.7489 


1.94 


A x C 


2 


606.9850 


303.49J0 


2.4658* 


2.30 


B x C 


2 


570.0480 


285.0240 


2,3158* 


2.30 


A x B x C 


4 


299.0370 


74.7590 


0.607* 


1.94 


Error 


288 


35446.5990 


123.0780 






Total 


305 


40329.4420 









*p <,10 

**p <,05 

<,01 



f) Significant reading nethoda by PLDK interactions were obtained on 
the Word Knowledge and Reading Subtesta, Analyses of the Interactions 
indicated that the SCRP reading group waa significantly superior to the 
1TA and W1C groups only aaong children who did not receive PLOK. More- 
over, anong children who were taught to read by the SCRP approach, those 
without PLOK experience were significantly superior to those with one 

and two years of PLOK. 

O 
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Table 16 



Analysis of Variance on the Follow-up Language Subtest Raw Scores of the 

Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A ( PLDK) 


2 


537.4600 


268.7300 


3.6804* 


2.30 


B (Reading Methods) 2 


50,5700 


25,2850 


0.3463 


2.30 


C (Sex) 


1 


928.4000 


928.4000 


12.7151** 


2.71 


A x B 


4 


175.2900 


43.8230 


0.6002 


1.94 


A x C 


2 


96.2300 


48.1150 


0.6590 


2.30 


B x C 


2 


35.3300 


17.6650 


0.2419 


2.30 


A x B x C 


4 


863.3200 


215.8300 


2.9559* 


1.94 


Error 


288 


21028.5200 


73.0160 






Total 


305 


23715.1200 









*p <.05 

**p <.01 



g) A significant PLDK by Reading Method by Sex Interaction war 
obtained on the Language Subteat. Girls were superior to boys In 1TA 
W/0, 1TA W/2| and Mtc W/l, For boys In the W/l group, there was a trend 
for the 1TA approach to be superior to both the WIC and SCRP methods. 
Furthermore, the girls in the ITA V/2 group were superior to girls in the 
SCRP M/2 group. Finally, the ITA W/0 girls were significantly superior 
to the ITA W/l girls, while the SCRP W/0 girls were superior to the SCRP 
W/2 girls. The conflicting nature of these findings precludes the 
drawing of unambiguous conclusions. 



47 



O 

ERLC 



Before concluding this section of the report, some date on teacher 
variability are introduced in Table 17. The information provided is 
mean grade equivalent post and followup scores on the Total Written 
Language Subtests of the Metropolitan Achievement Tests , as well as 
initial IQ scores, by ’’Treatment Groups," "Initial School Placements" 
and "Initial Teachers." It is interesting to compare these mean values 
with those found in Table 9, Generally, there is as much or more 
variability among teachers as among experimental reading treatment groups. 
Therefore, it is not surprising :hat equivocal and generally negative 
results were found on the experimental variables. Some teachers were 
apparently so incompetent that the intervention did not have a chance 
to demonstrate its effectiveness. The all-too-rate teacher (see Teacher 
#21 in Table 17) was outstanding. In fact, this particular teacher may 
have been what tipped the balance in favor of the SCRP group at time of 
posttesting. It la interesting to note that three ITA teachers, zero 
WIC teachers, and five SCRP teachers had their children, on the average, 
about the third grade level at posttesting. By the time of followup 
testing, the children from only two ITA teachers, zero WIC teachers, and 
one SCRP teacher were achieving, on the average, above the third grade 
level in written language. Because of these findings, the researchers in 
this investigation were forced to conclude that, without controlling for 
differences in teacher effectiveness, future research which attempts to 
discern the relative effectiveness of different methods of teaching 
beginning reading and/or oral language probably will be futile, or the 
results will be spurious. Either such comparisons of educational inter* 
vent ions should be tabled until more is known about controlling for the 



Table 17 
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Kean Grade Equivalent Post and Follow-up Scores on the Total Written 



Language Sub testa of the Metropolitan Achievement Testa 
and Initial IQ Scores by Treatment Groups, Initial 
School Placements and Initial Teachers 




Teacher 

Treatment Group Number 


IQ 


MAT Grade Equivalents 
Poat Follow-up 


ITA without 1 


PLDK (W/0) 








School A 


1 


92. *2 


1.82 


2.30 


School & 


2 


85.50 


3.18 


2.99 


School C 




87.69 


2.94 


3.05 


ITA with one 


year PLDK (W/l) 








School A 


4 


90,08 


2.67 


3.11 


School C 


5 


80.53 


2.13 


2.44 


School C 


6 


79.36 


2.43 


2.80 


ITA with two 


year* PLDK (W/2) 








School B 


7 


88.44 


3.16 


2.90 


School B 


8 


84.06 


2.91 


2.66 


School C 


9 


90.47 


2.38 


2.58 


WIC without : 


PLI* (W/0) 








School D 


10 


86.00 


2.62 


2.76 


School E 


11 


84.27 


2.27 


2.57 


School P 


12 


82.08 


2.50 


2.77 


WIC with one 


year PLDK (W/l) 








School D 


13 


96.00 


2.02 


2.28 


School B 


14 


87.26 


2.56 


2.98 


School P 


15 


86.00 


2.81 


2.68 


WIC with two 


year* PLDK (W/2) 








School D 


16 


86.77 


2.47 


2.65 


School E 


17 


86.89 


2.42 


2.86 


School t 


18 


85.83 


2.41 


2.60 


SCR? without 


PLt* (W/0) 








School G 


19 


89.67 


3.16 


2.76 


School H 


20 


84.80 


2.16 


2.67 


School 1 


21 


90.94 


3.67 


3.64 


SCftF with one year Mi* (W/l) 








School G 


22 


86.12 


3.01 


2.82 


School H 


23 


87.27 


2.28 


2.39 


School J 


24 


91.60 

• 


2.26 


2.36 


SCR? with two yeera Mi* (W/2) 


• 






School 0 


23 


85.33 


3.00 


2.75 


School R 


26 


90 JO 


3.18 


2.80 


School H 


27 


92.50 


2.83 


2.76 
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teacher variable by selecting only adequate teachers or by covariance or 
some such statistical technique, or research designs should be utilized 
in which the teacher is kept constant across treatment. This might 
necessitate the use of some type of counter-balanced design in which a 
group of teachers would use one method for one or more years, and these 
same teachers a different method with comparable children for another 
one or more years. Another method would be for the same teachers to try 
out two or more new approaches concurrently, by teaching one procedure in 
the morning and another in the afternoon of the same day, and then 
reversing the order the next day, (We contemplated deleting from the 
experiment teachers rated as "poor" and "excellent" when analyzing our 
data, but did not have a sufficient subject pool to enable us to do thic-- 
see page 13 for the procedures used to rate the teachers,) 

The following conclusions are drawn from the KAT data: 

a) Upon the termination of the two year experimental period, the 
SCRP experimental reading approach was superior to the 1 TA and VIC 
approaches when measured by overall written language achievement. How- 
ever, at time of followup, no significant difference remained in favor of 
the SCRP group. In fact, during their third year in school, the SCRP 
group actually declined in school achievement. This decrement suggests 
that more effective teaching by the SCRP teachers during the initial two- 
year experimental period may have accounted for the earlier initial 
advantage of this treatment, 

b) As anticipated, girls achieved generally at a significantly 




higher level than boys in the written language aubteats of the Metro- 
politan Achievement Testa , regardless of experimental reading approach 
they received. 
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c) There was some slight evidence to Indicate that the PIDK 
lessons tended to equalize school achievement for boys in contrast 
to girls. In short, there was an Indication that boys are more in 
need of the PLDK exercises than girls. 

d) The variability in pupil progress among teachers within the 
various experimental reading programs was as great as among the 
experimental reading programs themselves, suggesting that some 
greater control of the teacher vatlable than was the case in this 
study is required when investigating the relative effectiveness of 
different educational interventions. 

5) Written Language Development . Data on the written language 
development which was obtained from Myklebust's Writt en Picture Story 
Language Test appear in Table 18. The task for each subject was to 
write a creative story stimulated by the standard picture provided in the 
test kit. The means in Table 18 Indicate that, amona the PLDK treatment 
groups, the W/O children were superior to children in the other two 
groups (W/l and W/2). Furthermore, among the experimental reading 
approaches, the 1TA group tended to be superior to the other two rending 
groups on two related measures of productivity (total words and total 
sentences written), as well as on the degree of abstraction, but these 
differences did not reach statistical significance. The SCKP group was 
superior to the other groups In words per sentence. The WtC group was 
inferior on all measures. 

The analyses of variance for the five measures on Hyklebust's 
Written Picture Story language Teat appear in Tables 19 th-. ough 23. 

The teaulte from these analyses are discussed below: 



0 
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Heine and Standard Deviation. of Score. on Hyklcbuat'a Written Picture Story Unguege Teat 









Productivity 




Syntax 

Quotient 


Degree of 
AbatractSon 


Traatmeat Croup 


K 


Total 

Word* 


Total 

Sentence* 


Worda per 
Sentence 




X s 


X S 


X S 


X 3 


X S 



ITA without PUX 
Boya 
ClrU 
Total 


20 

20 

40 


66.15 52.56 

75.50 42.93 

70.82 47.60 


8.75 

9.20 

8.98 


4.82 

4.29 

4.51 


7.78 
7.9 B 
7.86 


2.91 

2.18 

2.54 


86.97 6.49 
89.08 6.68 
B3.02 6.59 


9 .40 
9.90 
9.65 


5.09 

3.93 

4.50 


*[TA with one year PU*C 
Boya 20 

Cirli 20 

Total *0 


57.10 33.95 

55.25 44.24 

56.18 38.93 


7.60 

7.55 

7.68 


4.62 

5.03 

4.77 


7.64 

6.24 

6.94 


1.88 

3.25 

2.71 


83,27 20.56 

69, 33 16.54 

76.30 30.10 


a. 60 
7.30 
7.95 


4.12 

5.82 

5.02 


ITA with two year a 
Boya 
Git la 
Total 


PLDK 

20 

20 

40 


90.95 84.82 

74.95 48.99 

82.95 68.85 


11.05 

9.50 

10.28 


9.39 

5.78 

7.74 


7.45 

7.39 

7.42 


3.55 

2.19 

2.91 


73.72 12.98 

84.60 10.69 

79.16 24.82 


10.80 
9.80 ■- 
10.30 


7.63 
4% 71 
6.28 


WIC without PUK 
Boya 
Glrla 
Total 


17 

17 

34 


57.12 35.67 

69.18 37.41 

60.65 37.11 


6.29 

9.29 
7.79 


3.46 

5.23 

4.62 


6.88 

7.92 

7.40 


3.43 

2.49 

3.00 


69.94 34.51 

88.21 9.59 

79 .07 26.61 


7.76 

9.88 

8.82 


6.41 

4.26 

5.46 


WIC with one PLDK. 

Boya 12 

Glrla 12 

Total 34 


55.70 39.15 

65.71 25.95 

60.71 33.10 


7.71 

8.29 

8.00 


5.42 

3.41 

4.4? 


5.71 

8.41 

7.06 


3.36 

2.23 

3.12 


62.01 41.98 

85.08 11.46 

73.54 12.48 


6.94, 

10.35 

8.65 


7.05 

3.97 

5.89 


WIC with two yeara 
. Boya 
Girli 
Total 


PLDK 

17 

17 

34 


42.06 28.26 

63.53 37.34 

52.79 34.38 


6.29 

8.76 

7.53 


4.73 

5.18 

5.04 


6.76 

6.48 

6.62 


2.35 

2.69 

2.49 


81.49 23.27 

81.91 23.05 

82.70 22.84 


6.82 

9.71 

8.26 


3.66 

5.75 

4.97 


SCRP without PLDK 
Boya 
Glrla 
Total 


14 

14 

28 


67.29 42.37 

93.79 35.94 

80.54 40.85 


7.86 

10.43 

9.14 


4.55 

4.94 

4.64 


8.41 

8.77 

8.59 


3.74 

3.56 

3.59 


81.14 24.71 
90.41 7.56 

86.78 18.11 


9.00 

11.36 

10.18 


4.69 

4.77 

4.79 


SCRP with cne y*ar 
Boya 
Glrla 
Total 


PLDK 

14 

14 

28 


42.86 24.59 

61.00 26.74 

51.93 26.84 


6.07 

8.50 

7.29 


3.36 

4.24 

3.95 


5.56 

7.06 

6.31 


2.81 

2.62 

2.78 


68.21 37.69 

81.08 24.17 
74.65 31.75 


6.50 

8.71 

7.61 


4.55 

4.94 

4.79 


SCRP with two yeara PLDK 
Boya 14 

Glrla 14 

Total 28 


72.29 42.85 

60.50 40.56 

66.39 41.38 


9.43 

8.14 

8.79 


5.52 

4.94 

5.18 


7.86 

7.04 

7.45 


1.59 

2.85 

2.30 


87.20 6.72 
83. B9 25.05 
85.54 18.07 


8.50 

7.43 

7.96 


4.70 

4.67 

4.63 


Experimental Reading Totala 

m 120 69.98 53.98 

yjC 102 58.05 34.76 

$CJip 84 66.29 38.37 


8.98 

7.77 

8.40 


5.90 

4.67 

4.70 


7 .41 
7.03 
7.45 


2.73 

2.87 

3.05 


81.16 23.20 

78.44 27.58 

82.32 23.94 


9.30 

8.58 

8.58 


5.37 

5.41 

4.82 


Experimental PUK Totala 
Without PLDK 102 


7C.10 42.00 


8.63 


4.6) 


7.91 


3.01 


84.70 18.81 


9.52 


4.90 


With Ont Year 
PLDK 


102 


56.52 33.00 


7.68 


4.42 


6.81 


2.86 


74.93 31.07 


8.09 


5.24 


With Two Yeara 
FUX 


102 


60.35 53.30 


8.95 


6.32 


7.16 


2.62 


82.09 22.41 


8.98 


5.49 


Gt end ErpertBencil Tote) 

Boy. 

Ctrl* 153 

Total 3W 


61.35 46.51 

68.63 39.51 

64.99 44.31 


8.00 

8.84 

8.42 


5.58 

4.79 

5.21 


7.13 

7.45 

7.29 


2.99 

2.7) 

2.86 


77.43 28.50 
81.71 20.32 
80.5 7 24.91 


8.35 

9.37 

8.86 


5.56 

4.84 

5.23 
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Table 19 

Analysis of Variance of Total Words on Myklebust's Written 
Picture Story Language Test 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


* .90 


A (PLDK) 


2 


11133.2000 


5566.6000 


2.9430* 


2.30 


B (Reading Methods) 2 


8047.1000 


4023.5500 


2.1272 


2.30 


C (Sex) 


1 


4062 . 8000 


4062.8000 


2.1479 


2 . 71 


A x B 


4 


16113.2000 


4028.3000 


2.1297* 


1.94 


A x C 


2 


4596.6000 


2298.3000 


1.2151 


2.30 


B x C 


2 


5369.8000 


2684.9000 


1.4195 


2.30 


A x B x C 


4 


4873.4000 


1218.3500 


0.6441 


1.94 


Error 


288 


544752.9000 


1891.5030 






Total 


305 


598949.0000 









*p <.10 



a) On the PLDK dimension (A) , there was a significant main 
effect on three of the five subte9ts. In two cases, the W/0 and 
W/2 groups were superior to the W/l groups; in one ease, the W/0 
group was superior to the W/l and W/2 groups (words per sentence) . 

b) In terms of the main effect on the experimental reading 
dimension, there was no significance on any of the five measures. 

c) In terms oi the main effect analyses on boys vs. girls, 




there were significant differences between the sexes on two of the 
five subtests, with girls superior to boys in both cases. 
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TabJ.e 20 

Analysis of Variance of Total Sentences on Myklebust's Written 
Picture Story Language Test 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F 

.90 


A (PLDK) 


2 


09.5360 


44.7680 


1.6661 


2.30 


B (Reading Methods) 2 


79.4800 


39.7400 


1.4790 


2.30 


C (Sex) 


1 


53.5420 


53.5420 


1.9927 


2.71 


A x B 


4 


103.8280 


25.9570 


0.9660 


1.94 


A x C 


2 


52.2010 


26.1010 


0.9714 


2.30 


B x C 


2 


88.7330 


44.3670 


1.6512 


2.30 


A x B x C 


4 


62.6650 


15.6660 


0.5830 


1.94 


Error 


288 


7738.4730 


26.8700 






Total 


305 


8268.4580 









d) There was one significant PLDK by reading method <A x B) 
interaction, namely on the total words measure. The ITA W/2 group 
was superior to the ITA W/l group, as well as the WIC W/2 group. 
Furthermore, the SCRP W/0 group was superior to the SCRP W/L group. 

e) There were two Reading Methods by Sex (B x C) interactions — 
for Syntax and Degree of Abstraction. In both cases the boys in 
ITA group were superior to the girls In ITA group. However, the 

i 

girls in WIC group were superior to the boys in WIC group. Since no 
logical argument is known for how one experimental reading method 
could have a differential effect from another on the Myklebust Test, 
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Table 21 

Analysis of Variance of Words Per Sentence Scores on Myklebuet’s 
Written Picture Story Language Test 





Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F . 90 



A (PLDK) 


2 


6518.9000 


3259.4500 


4.1229* 


2.30 


B (Reading Methods) 


2 


1100,5000 


550.2500 


0.6960 


2.30 


C (Sex) 


1 


765.5000 


765.5000 


0.9683 


2.71 


A x B 


4 


3554.1000 


888.5250 


1.1239 


1.94 


A x C 


2 


1740.1000 


870.0500 


1.1005 


2.30 


B x C 


2 


3406.3000 


1703.1500 


2.1543 


2.30 


A x B x C 


4 


5435.2000 


1358.8000 


1.7187 


1.94 


Error 


288 


227685.9000 


790.5760 






Total 


305 


250206.5000 









*p <.05 



one must conclude that these findings are due to a statistical 
artifact created by running multiple t-tests with a probability of 
getting 10 out of 100 significant due to chance, or to a bias in 
teacher and/or pupil selection. 

There was one significant triple interaction across PLDK by 
Reading Method by Sex (A x B x C) for the Syntax area, The multiple 
t^-test breakdown revealed that girls were superior to boys in W1C 
W/0 and WIC W/l groups, Between PLEK treatments, 1TA W/0 and W/2 
girls tended to be superior to ITA W/l girls. The WIC W/2 boys 



0 
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Table 22 



Analysis of Variance of Syntax Quotient Scores on Myklebust’s 
Written Picture Story Language Test 



Source of 
Variation 


Degrees of Sum of 

Freedom Squares 


Mean 

Squares 


F Ratio 


F .90 


A (PLDK) 


2 


522200.0000 


261100,0000 


4.4400** 


2.30 


B (Reading Methods) 2 


76280.0000 


38140.0000 


0.6486 


2.30 


C (Sex) 


1 


301290.0000 


301290.0000 


5.1234** 


2.71 


A x 8 


4 


170860.0000 


42715.0000 


0.7264 


1.94 


A x C 


2 


29860.0000 


14930.0000 


0.2539 


2.30 


B x C 


2 


307660.0000 


153830.0000 


2.6159* 


2.30 


A x B x C 


4 


579660.0000 


144915.0000 


2.4643** 


1.94 


Error 


288 


16936370.^000 


58806.8400 






Total 


305 


18924180.0000 









*p <.10 

**p <.05 



were superior to the WIC W/l boys. Furthermore, the SCRP W/0 boys 
tended to be superior to the SCRP W/l boys, Among reading groups, 
the ITA W/0 and W/l boys were superior to the WIC W/0 and W/l boys. 
The ITA W/l girls were superior to the WIC W/l girls. Again, the 
findings are inconsistent ard inconclusive. 

The following conclusions are drawn from the followup data on 
Myklebust's Written Picture Story Language Test analyses: 




a) Little evidence was found to support the effectiveness of 
the PLDK leasona. As on other measures, the W/0 group was generally 



Analysis 


of Variance of 
Written 


Abstract-Concrete Scores on 
Picture Story Language Test 


. Myklebust: r a 




Source of 
Variation 


Degrees of Sum of 

Freedom Squares 


Mean 

Square 


F Ratio 


F 

.90 


A (PLDK.) 


2 


106.6080 


53.3040 


1.9793 


2.30 


B (Reading Methods) 2 


37.7460 


18.8730 


0.7008 


2.30 


C (Sex) 


1 


79 .5290 


79.5290 


2.9531* 


2.71 


A x B 


4 


12 5.4050 


31.3510 


1.1641 


1.94 


A x C 


2 


22.4880 


11.2440 


0.4175 


2.30 


B x C 


2 


160.3340 


80.1670 


2.9767* 


2. 30 


A x B x C 


4 


55.9750 


13.9940 


0.5196 


3 .94 


Error 


288 


7756.1510 


26.9310 






Total 


305 


8344.2360 









*p <.10 

superior to the group with one year of PLDK lessons (VJ/1) . 

b) As anticipated, the different experimental reading methods 
had no appreciable differential effect on the Myklebust test scores. 

c) Girls were superior to boys on two of the five measures. 

6) Q ra l Language Development . The £ral Picture Story Languag e Teat, 
was designed to parallel the Myklebust's W ritten Picture Story Language 
Test , Each subject was again presented with a picture and asked to 
generate a story, this time by telling it orally to the examiner, who in 
turn tape-recorded it. Measures of productivity and level of abstraction 
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were obtained, (There was no written story upon which to obtain a 
measure of grammatical correctness (syntax) which included punctuation, 
etc,) 

The descriptive statistics on productivity (total words, total 
sentences, and words per sentence), and degree of abstraction (abstract- 
concrete) scores of the Oral Picture Story Language Test appear in 
Table 24, On all four measures, the girls were superior to the boys, 

In contrast to other results, on three of the four measures, the WIC 
group obtained slightly higher scores than both the ITA and SCRP groups, 
The W/l PLDK group was somewhat higher than the W/0 and W/2 PLDK groups — 
on three of the measures. 

The analyses of variance data on the four measures appear in 
Tables 25 through 28, The results of these analyses are summarized below: 

a) Significant differences among PLDK groups were obtained on 
words per sentence and degree of abstraction scores. On words per 
sentence, the W/l PLDK group was significantly superior to the W/0 
group. The VJ/1 group was also superior in comparison to both the 
W/C and W/2 groups on degree of abstraction scores, The differences 
between reading treatments failed to reach statistical significance 
in all analyses, 

b) Girls were significantly superior to the boys only on words 
per sentence (10,59 vs, 9,80), 

c) Significant PLDK by reading method, and reading method by 
sex interactions were obtained on the words per sentence analysis. 
The t- test analyses of these interactions yielded a number of 
inconsistent results which failed to support the efficacy of any of 



Table 24 



Meant and Standard Deviation* on Score*, of the Oral Tiotute Story Language Teat 



Treatment Group N 



ITA without PLDK 


Boya 


20 


Girla 


20 


Total 


40 


ITA with one year 


PLDK 


Boya 


20 


Girla 


20 


Total 


40 


ITA with two yaira 


PLDK 


Boya 


20 


Girla 


20 


Total 


40 


WIC without PLDK 


Boya 


17 


Girla 


17 


Total 


34 


WIC with one year 


PLEK 


Boya 


17 


Girla 


17 


Total 


34 


WIC with two year# 


PLDK 


Boya 


17 


Girls 


17 


Total 


34 


SCRP without PLDK 


Boya 


14 


Girla 


14 


Total 


28 



SCRP with one year PLDK 
Boya 14 

Glria 14 

Total 2& 



SCRP with two yeara PLDK 



Boya 14 

Glria 14 

Total 28 

Experimental Reading Total* 
1TA 120 

WZC 102 

SCRP 84 

Experimental PJDK Total* 

Without FLUC 102 

With one year 

PLDK 102 

With two yeara 

PLDK 102 

Grand Experimental Total 
Boya 153 

Girla 153 

Total 306 







Productivity 






Degree of 
Abstraction 


Total 

Worda 


Total 

Sentence! 


Words per 
Sentence 


X 


s 


X 


S 


X 


S 


X 


S 


75.65 


29.91 


8.40 


3.03 


9.30 


2,32 


9.85 


3.51 


115.35 


54.53 


11.70 


6.20 


10.26 


1.96 


10.20 


3.07 


95.60 


47.82 


10.05 


5. 1C 


9.78 


2.18 


10.02 


3.26 


92.00 


33.77 


9*80 


3.50 


9.46 


2.00 


10. bO 


3.63 


99.50 


52.29 


9.15 


5.80 


11.01 


2.70 


10.95 


3.85 


35.75 


44.38 


9.48 


4.32 


L/.24 


2.47 


10.78 


3*70 


90.65 


52,62 


9.60 


3*91 


9.12 


1.87 


9.55 


3*22 


88.45 


49.55 


8.10 


4.20 


11.02 


3.03 


9.20 


2.QC 


89.55 


50 ,46e 


8.85 


4.08 


10 *07 


2.66 


9.38 


2.69 


78.18 


42.25 


8.18 


3.81 


9.36 


1.94 


8.53 


2*58 


94.71 


95.32 


9.76 


8.73 


9.24 


1.91 


B . 53 


2.24 


86.44 


73.08 


8.97 


6.68 


9.30 


1.09 


6.53 


2.38 


138.76 


74.82 


12.41 


5. 69 


10.97 


1.70 


11.29 


3.90 


118.53 


62.73 


9.71 


3.92 


32.29 


3.62 


10.35 


2.89 


128.65 


68.76 


11.06 


5.00 


11.63 


2.86 


10.82 


3.42 


93.76 


42.08 


9.18 


4.59 


10.73 


2.17 


10.12 


3.22 


142.53 


193.87 


13.18 


15.79 


10.19 


2.35 


10.24 


3.96 


116.15 


140 , 34 


11.18 


11.63 


10.49 


2.25 


10.18 


3.55 


115.93 


73.98 


10.50 


6.43 


10.61 


2.30 


9.57 


2.93 


97.43 


19.07 


9.29 


2.16 


10.69 


1.72 


9.93 


3.29 


106.68 


53.85 


9.89 


4.75 


10.65 


2.00 


9.75 


3.06 


84.29 


35.96 


9.07 


3.10 


9.24 


2.12 


10,29 


2.89 


105.64 


53.47 


10.14 


4.69 


10.41 


2.44 


10.50 


2.38 


94.96 


46.02 


9.61 


3.94 


9.82 


2.32 


10.39 


2.60 


104.29 


53.13 


10.64 


4.88 


9.66 


2.26 


10.57 


2.65 


102.07 


28.96 


10.21 


2.52 


9.94 


1.23 


10.21 


2,49 


103.18 


42.00 


10.43 


3.81 


9.80 


1.79 


10.39 


2.53 


93.63 


47.31 


9.46 


4.51 


10.03 


2.43 


10.06 


3.26 


111.08 


100.25 


10.40 


8.24 


10.47 


2.53 


V .84 


3.28 


101.61 


47.23 


9.98 


4.15 


10.09 


2.06 


10. IB 


2.72 


95.59 


58.87 


9.65 


5.56 


9.86 


2,09 


9.45 


2.98 


106.50 


55.85 


10.04 


4.48 


10.59 


2.66 


10.69 


3.31 


102.82 


89.66 


10*06 


7.45 


10.14 


2.31 


9,92 


2.97 


96.18 


52.51 


9,70 


4*43 


9.80 


2.14 


10.03 


3.24 


107.10 


83.31 


10.12 


7.15 


10.55 


2.53 


10.01 


3.01 


101.64 


69,74 


9.92 


5.94 


10.19 


2.37 


10.02 


3.12 
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Table 25 

Analysis of Variance of Total Words on the Oral Picture 







Story Language 


Test 






Source of 
Variation 


Degrees of Sum of 

Freedom Squares 


Mean 

Square 


F Ratio 

i 


F .90 


A (PLDK) 


2 


6287.5000 


3143.7500 


0 .6548 


2.30 


B (Reading Methods) 2 


16779.3000 


8389.6500 


1.7474 


2.30 


C (,Sex) 


i 


9124.9000 


9124.9000 


1.9006 


2.71 


A x B 


4 


29568.9000 


7392.2250 


1.5397 


1.94 


A x C 


2 


3020.9000 


1510.4500 


0.3146 


2.30 


B x C 


2 


3318.8000 


1659.4000 


0.3456 


2.30 


A x B x C 


4 


32387.4000 


8096.8500 


.1.6854 


1.94 


Error 


288 


1382737.1000 


4801.1700 






Total 


305 


1483224.8000 










the various treatment combinations. 

In light of these analyses , the following can be concluded from the 
Oral Picture Story la nguage Test data: 

a) There was only slight evidence in support of the PLDK pro- 
gram. On one measure, the W/l group was superior to the W/O group* 
while on another measure the W/l group was superior to both the W/0 
and W/2 groups. 

b) As anticipated, overall, different experimental reading 
programs did not have a differential effect on measures of oral 
language development. 
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Table 26 

Analysis of Variance of Total Sentences on the Oral 
Picture Story Language Teet 



Source of 
Variation 


Degrees of 
Free dom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


1 .90 


A (PLDK) 


2 


11.0040 


5.5020 


0.1554 


2.30 


B (Reading Methods) 2 


49.5260 


24.7630 


0.6995 


2.30 


C (Sex) 


1 


13.3850 


13.3850 


0.3781 


2.71 


A x B 


4 


132 .2740 


33.0690 


0.9341 


1.94 


A x C 


2 


72.2620 


36.1310 


1.0206 


2.30 


B x C 


2 


15.3240 


7.6620 


0.2164 


2.30 


A / B x C 


4 


273.9720 


68.4930 


1.9347 


1.94 


Error 


288 


10196.0440 


35.4030 






Total 


305 


10763.7910 









c) On one out of four measures only, girls were significantly 
superior to boys in the ability to relate a story orally. 

II. The Second A nalysis (PLDK Treatments Differences by Sex) 

This section examines the effectiveness of the PLDK treatments. On 
page 19, under Analysis of Data (and in Figure 2) the analysis of 
variance design used in this portion of the report was described. It is 
different from the first analysis in two important ways. First, it 
includes data on the control group. Second, the data across the three 
^experimental reading treatments were combined. 
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Table 27 

Analysis of Variance of Words Per Sentence Scores on the 
Oral Ficture Story Language 'lest 



Source of 
Variation 


Degiees of Sum of 

Freedom Squads 


Mean 

Square 


F Ratio 


F .90 


A (PLDK) 


2 


2759.4000 


1379.7000 


2.6333* 


2.30 


B (Reading Methods) 2 


1210.7000 


605 . 3500 


1.1641 


2.30 


C (Sex) 


1 


4682.3000 


4682 . 3000 


9.0044** 


2. 71 


A x B 


4 


8201.4000 


2050.3500 


3.9430** 


1.94 


A x C 


2 


1421.7000 


7 10. 8 >00 


1.3670 


2 30 


B x 0 


2 


2429.8000 


1214 . 9000 


2.3363* 


2.30 


A x B x C 


4 


1210.2000 


3 .5500 


0.5818 


1.94 


Error 


288 


149760.6000 


520.0020 






Total 


305 


171676.1000 









*p < . 1 0 
**p <.01 



O 

ERIC 



The PtDk analyses were perforaed on all 354 subjects described In 
Table 1. These data are collapsed and reproduced again In Table 29. 
Exaaination of Table 29 reveals that the groups were highly siallar on 
pretest CA, IQ, and LA. In Table 2, the analysis of variance revealed 
that no significant differences existed among treatment groups on these 
three pretest measure*. 

1) General I ntellectual func t ionin g. The pte-, post-, followup- 
teat dtta and gain scores on *. \p. Stanford - Blnet Intelligence Scale are 
reported In Table 30. tn terms cf overall totals, the averagn !Q of the 
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Table 28 

Analysis of Variance of Abstract-Concrete Scores on the 
Oral Picture Story Language Test 



Source of ) 

Variation 


Agrees of 
Freedom 


Sum of 
Squares 


Meai 

Square 


F Ratio 


F .90 


A (PLJK) 


; 


79.2940 


39.6470 


4.0593* 


2.30 


B (Reading Methods) 2 


5.4780 


2. 7 390 


0 . 2804 


2. 30 


C (Sex) 


i 


0.0520 


0.0520 


0.0053 


2.71 


A x B 


4 


62.8230 


15.7060 


1.6081 


1.94 


A x C 


2 


2.6910 


1.3460 


0.1378 


2.30 


D x C 


2 


2.3840 


1.1920 


0.1220 


2.30 


A y B x C 


4 


8.3000 


2.0750 


0.2125 


1.94 


Error 


288 


2812.8610 


9.7670 






Total 


305 


2973.8830 









*p <.05 



354 subjects, upon entering school, vas 86.87. The average IQ score had 
risen only 2.74 points to 89.61 by the end of the second grade, by the 
end of the third grade this had dropped back 0.96 points to 88.65. In 
terrs of these descriptive statistics, the gains and losses from pre-, to 
post-, to follovup-teating appear to be uinl&a*. 

The analysis of variance data in Table 31 reveal no significant 
rLCK effect, regardless of sex. Thus, the other data It. this table are 
secondary and largely Irrelevant to the basic hypothesis regarding the 

effectiveness of the PLDR activities, though the interaction involving 

O 
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Table 29 

MeanB and Standard Deviations on Pretest Data for the Selected 
Samples Used In the PLDK Analyses 







CA 


.. IQ 


LA 


Treatment Group 


N 


X S 


X s 


X s 



• Without PLDK 



Boys 


51 


74.22 


3.76 


86.84 


9.95 


62.12 


7.53 


Girls 


51 


74.18 


3.82 


87.63 


10.88 


62. J4 


8.25 


Total 


;o2 


74.20 


3.77 


87.24 


10.38 


62.53 


7.87 


One Year PLDK 


Boys 


51 


74.14 


4.22 


86.82 


11.29 


62.88 


8.44 


Girls 


51 


73.53 


4.03 


86.41 


11.81 


62.43 


9.16 


Total 


102 


73.83 


4.12 


86.62 


11.50 


62.66 


8.77 


Two Years PLDK 


Boys 


51 


74.37 


4.67 


89.02 


9.58 


62.02 


8.42 


Girls 


51 


73.55 


1.88 


85.86 


9.65 


63.76 


8.51 


Total 


102 


73.96 


4.29 


87.44 


9.70 


62.89 


8.47 


Covit rol 


Boys 


24 


73.75 


3.69 


83.00 


10.19 


60.50 


5.60 


Girls 


24 


73.04 


1.56 


87.79 


10.27 


60.12 


6.43 


Total 


48 


73.40 


1.60 


85. M) 


10.40 


60.31 


5.97 



Grand Total 



Boys 


177 


74.18 


4.13 


86.94 


10.36 


62.09 


7.82 


Girls 


177 


73.60 


3.85 


86.79 


10.69 


62.65 


8.39 


Total 


354 


73.92 


4.00 


86.87 


10.51 


62.37 


8.10 



PLDk arc relevant. 

There vaa a significant Min effect for "Test Years." Tha t-test 
breakdown revealed a significant overall difference between pre- and 
post-testing two years later. Hcvever, there was no significant gr<vth 
in IQ scores occurring fro* post to follcvup testing. 

There was a significant triple interaction among Test Years by PLDK 

Treatments by Sex, and a double interaction between Test Years and PLDK 




Him* tad Ittadtrd Dtvlttloat »a JO i e«t»« of tht Sttafo: UttUl|tac« Sc.l.i 

ftitMt*, To.tu.t-, Tollcw-Mp-, tni Cola Scortt 



Trtitwi&t Crov,> 


M 




Fra 


Foot 


follov-up 


G*lo* 


Cain* 


Calo c 


Without FU* 




e 














6oya 


n 


U.l( 


91.55 


59. i! 


4.69 


2.65 


-2.06 






1 


9.95 


15.05 


11.25 






Ctrl! 


>1 


X 


12.6) 


66.60 


66.12 


1.12 


0.49 


-0.66 






s 


10.16 


15.96 


15.16 








Total 


102 


I 


61.24 


«K>.1! 


66.29 


2.95 


1.55 


-1.56 






f 


10.56 


15.52 


12.42 




0oa Ttar FUR 


















loya 


51 


y 


66.62 


P9.55 


69.41 


2.55 


2.59 


0.06 






% 


11.29 


15.46 


15.62 






Ctrl* 


51 


X 


66.41 


69.10 


69.22 


2.69 


2.66 


0.1? 






* 


11.61 


25.96 


i;.o? 






Total 


102 


y 


66.62 


69.25 


69.54 


2.61 


2.22 


0.11 






s 


11.50 


15.66 


14.59 






TVo Yurt FtCR 


















lojra 


51 


y 


69.02 


61,25 


69.00 


2,21 


-0,02 


-2.75 






s 


**56 


15.42 


11.21 








Ctrl* 


51 


X 


65.66 


90.55 


62.16 


4.49 


1.52 


-5.17 






s 


9.65 


22.95 


11.10 








Total 


102 


y 


61.44 


91.04 


66.09 


5.60 


0.65 


-2,95 






$ 


9.20 


15.14 


11.59 








Control 


















!o|t 


24 


s 


65.00 


6’.62 


66.92 


4.62 


5.92 


-0.20 




s 


10.1* 


14.51 


15.62 








Cirla 


24 


X 


62.29 


94.25 


69.12 


-5.04 


1.56 


4.42 






1 


10.22 


10.42 


14.24 








total 


41 


I 


65.40 


16.19 


66.04 


0.29 


2.64 


1.65 






s 


10.40 


12.59 


15.95 








CtaM total 


















loy* 


in 


X 


66.94 


00.45 


66.92 


5.49 


2.05 


-1.46 




1 


10.56 


15.45 


12.5? 








Cirla 


12? 


y 


66.29 


26.29 


66.52 


2.00 


1.55 


-0.42 






s 


10.69 


15.25 


15.27 








total 


554 


X 


66.62 


69 *61 


66.65 


2.24 


1.76 


*0.96 






% 


10.51 


15.56 


12.91 










'fctu.t tit at ftttut IQ. 
•fellow mi. tttt alt*. ftttttl IQ. 
'folio.-** tut kttw fotttttt IQ 
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Table 31 

Analysis of Variance of IQ Scores on the 
Stanford-Bl.net Intelligence Scale 



Pretest, Posttest, and Follow-up Test 




Source of 


Degrees of 


Sum of 


Mean 






Variation 


Freedou 


Squares 


Square 


F Ratio 


F .90 


Betveen Subjects 


353 


129932.5920 


368.0810 






B (PLDK) 


3 


59 3.9890 


197.9960 


0.5318 


2.08 


C (Sex) 


1 


176.5430 


176.5430 


0.4742 


2.71 


B x C 


3 


333.6890 


111.2300 


0.2987 


2.08 


Error (b) 


346 


128828.3710 


372.3360 






Within Subjects 


708 


32226.0000 


45.5170 






A (Test Years) 


2 


1368.5500 


684.2750 


15.8872** 


2.30 


A x B 


6 


487.0600 


80.3430 


1.8654* 


1.77 


A X C 


2 


102.0870 


51.0430 


1.1851 


2.30 


A x B x C 


6 


468.3460 


78.0580 


1.8123* 


1.77 


Error (v) 


692 


29804.9580 


43.0710 






Total 


1061 


’62158.5920 









*p <.10 
**p <.01 
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treatment. The t-test vnalynes between pairs of data indicated a 
significant decrement in IQ scores from poatteat to followup teat for 
.both the boys and the girls within the PLDK W/2 group. Another inter- 
esting finding is that the controls had no significant increase in IQ 
scores from pre- to post-testing (0.79), but gained significantly from 
port- to followup-testing (1,85). A number of other t-test values were 
statistically significant but did not contribute to an understanding of 
the effectiveness of the PLDK exercises. 

The following conclusions are drawn regarding IQ scores: 

a) The PLDK exercises were rot demonstrated, at time of post- 
testing, to increase IQ scores significantly. It is not surprising 
that this finding contLxied into the followup analysis. 

b) Overall, the children in this experiment increased 
significantly in IQ scores (2.76 points) from pre- to post-testing, 
but declined in IQ sligntly during their third year in school 
(-0.96) . 

2) Peychollngulstlc Development . The yre-, post-, and followup- 
test data and gain language age (LA) scores or. the tlllnole Teut of 
Psychol lngula t ic Abilities a ppears in Table 32. In terms of overall totals, 
the 354 children gained 18.08 months in language during their first two 
years in school, or an average of 9.04 months yearly. During their 
third year in school they increased 8.!S months for s total of 26.63 
months from pre- to follcvup-teating. In terms of differences across 
PLDK groups, the gains from pre- to fo) lewup-testing were fairly even, 
with the largest (27.93) being .or the V/l group, end the smallest 
(24.63) for the control group. 




Table 32 
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Means and Standard Deviations for LA Scores on the 



Illinois Test cf Psychollnguistic Abilities 



Pre-, Post-, Follow-up, and Gain Scores 



Treatment Group 


N 




Pre- 


Post- 


Follow- 

up- 


Gain® 


GaJn b 


Gain c 


Without PLDK (W/0) 
















Boys 


51 


X 


62.12 


80.57 


38.49 


18.45 


26.37 


7.92 






S 


7.53 


11.19 


11.15 








Girls 


51 


X 


62.94 


80.12 


88.80 


17.18 


25.86 


8.68 






S 


8.25 


12.32 


12.00 








Total 


102 


X 


62.53 


80.34 


88.65 


17.81 


26.12 


8.31 






S 


7.87 


11.71 


11.53 








One Year PLDK (w/1) 
















Boys 


51 


X 


62.88 


82.10 


91.31 


19.22 


28.43 


9.21 






S 


8.44 


11.43 


12.64 








Girls 


51 


X 


62.43 


80.35 


89.86 


17.92 


27.43 


9.51 






s 


9.16 


11.85 


13.99 








Total 


102 


X 


62.66 


81.23 


90.59 


18.57 


27.93 


9.36 






s 


8.77 


11.62 


13.29 








Two Years PLDK (W/2) 
















Boys 


t i 
A 


X 


62.02 


83.18 


91.12 


21.16 


29.10 


7.94 






s 


8.42 


10.12 


12.36 








Girls 


51 


X 


63.76 


80.35 


88.25 


16.59 


24.49 


7.VO 






s 


8.51 


10.58 


10.99 








Total 


102 


X 


62.89 


81.76 


89.69 


18.87 


26.80 


7.93 






s 


8.47 


10.40 


11.72 








Control (C) 


















Boys 


24 


X 


60.50 


77.54 


85.08 


17.04 


24.58 


7.54 






s 


5.60 


10.92 


12.79 








Girls 


24 


X 


60.12 


75.00 


84.73 


14.88 


24.67 


9.79 






s 


6.43 


8.68 


8.71 








Total 


48 


X 


fO. 31 


76,27 


84.94 


15.96 


24.63 


8.67 






s 


5.97 


9.84 


10.82 








Grand Pots! 


















Boys 


177 


X 


62.09 


81.35 


89.60 


19.26 


27.51 


8.25 






s 


7.82 


10.98 


12.25 








Girls 


177 


X 


62.65 


79.56 


88.41 


16.91 


25.76 


8.85 






s 


8.39 


11.31 


11.97 








Total 


354 


X 


62.37 


80.45 


89.00 


18.08 


26.63 


8.55 






s 


8.10 


11.17 


12.11 










‘Pcettest ainus pretest IQ. 
b Follcarup test ainus pretest IQ. 
c Follciwup test ainus posttest IQ. 
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The analysis of variance data on these statistics are reported In 
Table 33. They were significant main effects on the PLDK variable and 
on test yeais, as well as a significant interaction between test years 
and PLDK treatment. The t-test breakdown revealed that the W/0, W/j., 
and W/2 group gained in LA over the controls during the three year 
period — with no significant differences among the W/0, W/l, and W/2 
groups. All three experimental veading groups gained significantly 
more than the controls, Beth boys and girls gained significantly in 
LA from pre- to post-testing, and from post- to followup-testing, with a 
larger gain from pre- to post-testing than from post- to followup, 
testing which vao anticipated since a two-years growth period was bring 
compared with onr year of growth. The boys made greater gains than 
glrln from pretest to posttest e/aluatlons. 

The following conclusior is drawn with respect to the effective- 
ness of the PLDK exercises in stimulating overall language age scores 
on the ITPAt 

a) There was no significant difference in the gains made by the 
W/0, W/l, and W/2 groups over the thrne year period. However, all three 
experimental reading groups obtained higher* scores than the controls. 

One finds no support for the PLDK treatment in the 1TPA-LA results. 

3) Creative Thinking . Followup scores on total Verbal Subtests of 
the Torrance Tests of Cteat lve Thinkin g are reported in Table 34. Exami- 
nation of the mean values in Table 34 reveals a gradual increment in 
values from 70. 58 for the controls, to 73.62 for the children in experi- 
mental reading programs without PLDK (W/0), to 84,27 for those with one 
year of PLDK (W/l), to 86.72 for those with two yeats of PLDK (W/2). 



O 
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Analysis of variance data on the Torrance Tests appear in Table 35. 

A significant main effect was obtained on levels of PICK only. There was 
not a significant main effect difference on boys vs. girls, or a 
significant interaction between the PLDK and sex dimensions. The t-test 
breakdown on PLDK treatments revealed, as expected, no significant 
difference between the controls and the W/0 group. Both the cne year and 
two year PLDK groups were cuperior to the non -PLDK and control groups. 
However, there was no significant difference between the W/l and W/2 
groups, indicating that one year vas as effective as two years of PLDK 
exercises in stimulating verbal performance on the Torrance Te sts of 
Creative Thinking . (These findings ate more heartening than those 
found in the CLDP where the positive effects of the PLDK in simulating 
creativity were lost in the followup year.) 

The following conclusions are drawn from the analyses of Verbal 
Subtest scores on the Torrance Test of Creative Thinking i 

a) One or two years of PLDK exercises are more effective than 
no PLDK training in stimulating verbal performance on the Torrance 
Teats of Creative Thinking . 

b) (Me year of PLDK exercises is equal lv as effective as two 
years of such exercises in stimulating creativity scores. 

6) School Achievement . Crude equivalent scores on the M etropolitan 
Achievement Tests are presented In Table 36 and raw scores in Table 37. 
The scores were derived from the five vtltten language subtest st s) Word 
Knew ledge, b) Word Discrimination, c) Reading Comprehension, d) Spelling, 
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Table 33 

Analysis of Variance for LA Scores on the Illinois Teat 
of Psycholinguistlc Abilities 
Pretest, Posttest, and Follow-up Test Scores 



Source of 
Variation 


Degrees of 
Freedca 


Sum of 
Squares 


He an 
Square 


F Ratio 


F .90 


Between Subjects 


353 


91747.4960 


259.9080 






B (PLMt) 


3 


2155.5490 


718.5160 


2.7839* 


2.08 


C iSex) 


1 


173.2970 


173.2970 


0.6714 


2.71 


B x C 


3 


116.9690 


38.9900 


0.1511 


2.08 


Error (b) 


346 


89301.6820 


258.0970 






Within Subjects 


708 


158128.6670 


223.3460 






A (Test Years) 


2 


130912.8660 


65456.4330 


1709.2403** 


2.30 


A x B 


6 


273.8100 


45.6350 


1.1917 


1.77 


A x C 


2 


264.0230 


132.0110 


3.4472* ‘ 


r.sr 


A x B x C 


6 


177.3920 


29.5650 


0.7720 


1.77 


Error (v) 


692 


26500.5750 


38.2960 






Total 


1061 


249876.1630 









*p <.05 
**p <.0l 
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Tablet 34 

Means and Standard Deviations on Total Verbal Subteat 
Scores of Torrance Tests of Creative Thinking 



Treatment Group 




X 


S 


Without PLDK 


Boys 


51 


77.59 


23.60 


Girls 


51 


69.65 


28.27 


Total 


102 


73.62 


26.21 


One Year PLDK 


Boys 


51 


83.53 


22.20 


Girls 


51 


85.02 


28.27 


Total 


102 


84.27 


25.30 


Two Years PLDK 


Boys 


51 


82.78 


33.91 


Girls 


51 


90.65 


32.23 


Total 


102 


86.72 


33.15 


Control 


Boys 


24 


66.46 


20.32 


Girls 


24 


74.71 


18.26 


total 


48 


70.58 


19.56 


Grand Total 


Boys 


177 


79.29 


26.66 


Girls 


177 


80.81 


29.45 


Total 


354 


80.05 


28.06 



O 
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Table 35 

Analysis of Variance on Total Verbal Subtest Scores 
of the Torrance Tests of Creativity 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


*.90 


A (PLDK) 


3 


14874.2610 


4558.0870 


6.6237* 


2.08 


B (Boys vs. Girls) 


1 


205.9322 


205.9322 


0.2751 


2.71 


A x B 


3 


3852.0138 


1784.0046 


1.7153 


2.08 


Error 


346 


258992.8778 


748.5343 






Total 


353 


277925.0848 









*p <.01 



and e) Language. The total written language score was obtained by 
averaging these five subtest6. Examination of Table 36 reveals that the 
354 subjects were achieving at the 2.61 grade level in March to April of 
their second year in school, and had increased their scores only to 
2.74 during their third year in school. (See page 37 for a discussion 
of these findings.) 

The analysis of variance on the poittest data collected in 1967 
are reported in an earlier monograph (Dunn, Neville, Pfost, Pochanart, 

6 Bruin inks, 1568), The few subjects vl?o were lost from posttesting to 
followup testing (from 408 to 354) wete scattered quite evenly across 
the various treatment groups, the posttest results of the present sample 
of 354 subjects directly parallel those obtained in the earlier analyses 
on the 408 subjects. The analyses contained in the earlier monograph 

O 




Grade Equivalent Meana and Standard Devlatlona on the Written Language Subtea ta 
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Total 354 14.46 7.56 15.15 8.98 12.89 7.59 12.89 6.37 13.18 11.40 
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(Dunn et al. # 1968) revealed that both the PLDK and non-PLDK experimental 
reading groups were significantly superior to the control group on overall 
written language achievement. Both W/0 and \v/2 PLDK experimental reading 
groups obtained significantly higher scores than the W/l and control 
groups, but did not differ significantly from one another. Furthermore, 
the one-year PLDK group was significantly superior to the controls. 
Finally, girls obtained significantly higher grade equivalent scores 
than the boys (girls « 2.76 in last year 1 ^ report vs. 2.78 in Table 35; 
boys « 2.40 in last year’s report va . 2.43 in Table 35). 

In Vble 38 is the analysis of variance on the followup total 
written language raw scores. The results are exactly parallel to last 
year (see Table 16 in last year’s report). There were main effects on 
both the PLDK and boys vs, girls dimensions, with no interaction between 
the two. On this year’s followup data, the t-test breakdown on the PLDK 
dimension revealed only a significant difference between the controls 
(2.23) and the tf/0 group (2.77) (experimental reading program without 
PLDK). Again girls achieved significantly above boys (girls « 2.80; 
boys “ 2.30). It appears that the PLDK exercises had no significant 
effect on overall written language achievement as measured after the 
children had completed three years in school. 

In Tables 40 through <*4 are the analysis of variance statistics for 
each of the five written language subtests of the MAT. In light of the 
inconsequential gains made by the subjects In each of the groups during 
their third year in school (see Table 37), it makes little sense to 
discuss — ad nauseam — the minutia concerning these subtests. However, the 
tables are included in the report for those few who may wish co study 
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Table 38 

Analysis of Variance on Total Written Language Raw Scores of the 
Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A (PLDK) 


3 


9332.8871 


3110.9623 


2.3017* 


2.08 


B (Boys vs. Girls) 


1 


19302.2485 


19302.2485 


14.2813** 


2.71 


A x B 


3 


8008.5161 


2669.5053 


1.9751 


2.08 


Error 


346 


467644.6082 


1351.5740 






Total 


353 


504308.2599 


• 







*p < . 10 
**p <.01 



them. The findings are summarized from them in Table 39 and indicate the 
following: 

In terms of main effects on the PLDK dimension, significance was 
obtained on three of the five subtests, namely Word Discrimination, 
Spelling, and Language. However, we wanr to point out that there is no 
evidence here to support the PLDK lessons since most of the differences 
occurred between the controls and the PLDK W/0 group. Generally, the 
pupils in the experimental reading program were achieving more than the 
pupils under control teacher. 

In terms of the main effects on boys vs. girls, significance was 
attained on four of the five subtests with girls always superior to boys. 
Again, this is not evidence in favor of the PLDK, Ijt rather supports the 
repeatedly discovered finding that girls do better than boys in school 



ERIC 



achievement during their years in the elementary grades. 
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Table 39 

Summary Table of Inferential Statistics Including t-test Value*,, 
for the Follow-up Raw Scores on the Five. Written Language 



Subtests of the Metropolitan Achievement Tests 



Variables 


Total 

Written 

Language 




Five Written Language Sub tests 




WK 


WD 


R 


S 


L 


Sig. PLDK 


Main Effect 


Yes 


No 


Yes 


No 


Yes 


Yes 


C x W/0 


2.4597* 


N/A* 


3.4395* 


N/A 


2.9325* 


1.7583* 


C x W/l 


1.0236 


N/A 


0.2769 


N/A 


1.7496* 


-0.1947 


C x W/2 


1.2203 


N/A 


0.5232 


N/A 


2.1201* 


0.0064 


W/O x W/l 


1.7943 


N/A 


3.9515* 


N/A 


1.4780 


2.4402* 


W/O x W/2 


1 .5486 


N/A 


3.6438* 


N/A 


1.0150 


2.1888* 


W/l x W/2 


-0.2457 


N/A 


-0.3077 


N/A 


-0.4630 


-0.2513 


Sig. Boys vs. 
Girls Main 
Effect 


Yes 


No 


Yes 


Yes 


Yes 


Yes 


Sig. PLDK x Sex 


Interaction 


No 


No 


No 


Yes 


No 


No 



* ■ Statistically significant values; N/A « not applicable 

Note : C - control; W/l - experimental reading treatr^nt without PLDK 
lessons; W/l ■ experimental reading treatment plus one year of PLDK lessons 
W/2 - experimental reading treatment plus two years of PLDK lessons; WK - 
Word Knowledge; WD “ Word Discrimination; R ■ Reading Comprehension; S ■ 
Spelling; L ■ Language, 
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\ 

There was one significant interaction between PLDK vs. sex, 

*n , 

\ 

namely on reading comprehension. Again, the ^-values were largely 
statistically significant between the controls and the W/0 group 
which provides no evidence in the effectiveness of the PLDK lessons. 
The most dramatic observation was that the W/0 g^-ls were achieving 
in reading comprehension (3.17) significantly above the controls 
(2.81), W/l (2.71) and W/2 (2.71) PLDK groups. This was probably 
due to the teacher variable, with one remarkably able teacher jn the 
W/0 experimental reading treatments having a better pupil achieve- 
ment history than any other teacher in the project (see Teacher if 21 
in Table 17.) 

The following conclusions are drawn from the MAT data concerning 
the effectiveness of the PLDK exercises: 

a) At the conclusion of the two year experimental period, both 
the PLDK and non-PLDK experimental reading groups were superior to 
the v ':.itrol8 in overall written language achievement, with the W/0 
and W/2 experimental groups both sjperior to the W/l PLDK group and 
the controls. In the followup analyses the W/O PLDK group was 
superior to the controls, and equal to the W/l and W/2 groups. 

b) Girls achieved generally at a significantly higher level than 
boys on the written language subteats of the Metropolitan Achievement 




Tests . 
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Table 40 

Analysis of Variance on Word Knowledge Subtest Raw Scores 
on the Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A (PLDK) 


3 


315.7087 


105.2362 


1.3155 


2.08 


B (Boys vs. Girls) 


1 


144.2825 


144.2825 


1.8036 


2.71 


A x B 


3 


349.7025 


116.5675 


1.4571 


2.08 


Error 


346 


27678.0691 


79.9944 






Total 


353 


28487.7628 









Table 41 

Analysis of Variance on Follow-up Word Discrimination Subtest Raw Scores 
of the Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F ,90 


A (PLDK) 


3 


1159.3209 


386.4403 


7.2835* 


2.08 


B (Boys vs . Girls) 


1 


726.1270 


726.1270 


13.6859* 


2.71 


A x B 


3 


95.7699 


*31.9233 


0.6016 


2.08 


Error 


346 


18357.4856 


53.0563 






Total 


353 


20338.7034 









CERIC 

f j 



*p <.01 
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Table 42 

Analysis of Variance on Follow-up Reading Comprehension Subtest 
Raw Scores on the Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Sauare 


F Ratio 


F ,90 


A (PLDK) 


3 


208.1769 


69.3923 


1.8287 


2.08 


B (Boys vs . Girls 


1 


624.0113 


624.0113 


16.4452** 


2.71 


A x B 


3 


358.8230 


119.6076 


3.1521* 


2.08 


Error 


346 


13128.9098 


37.9448 






Total 


353 


14319.9210 









*p <.05 

**p <.01 



Table 43 

Analysis of Variance on Follow-up Spelling Subtest Raw Scores on the 

Metropolitan Achievement Tests 





Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F 

.90 


A (PLDK) 


3 


1073.9991 


357.9997 


2.9374* 


2.08 


B (Boys vs. Girls) 


1 


1983.7400 


1983.7400 


16.2769** 


2.71 


A x B 


3 


686.3198 


228.7732 


1.8771 


2.08 


Error 


346 


42168.3705 


121.8739 






Total 


353 


45912.4294 









*p <.05 

**p <.01 



0 
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Table 44 

Analysis of Variance on Follow-up Language Subtest 
Raw Scores on the Metropolitan Achievement Tests 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F Ratio 


F .90 


A (PLDK) 


3 


563.4081 


187.8027 


2.5166* 


2.08 


B (Boys vs . Girls) 


1 


927.4830 


927.4830 


12.4288** 


2.71 


A x B 


3 


130.4 872 


43.4957 


0.5828 


2.08 


Error 


346 


25819.6867 


74.6233 






Total 


353 


27441.0650 









*p <.10 

**p <.01 



5) Written Language Development . The written language development 
descriptive data obtained from Myklebust's Written Picture Story 
Language Tes t are found in Table 43. It will be recalled the task for 
each subject was to write a creative story stimulated by the standard 
picture provided in the test kit. Examination of the means in Table 45 
indicates, in almost all cases, that the W/0 PLDK group was superior to 
all three other groups (Controls, W/l PLDK, and W/2 PLEK) . Furthermore, 
with two exceptions, the control group always attained the lowest crea- 
tivity score. Tables 47 through 31 provide the analyses of variance data 
for each of the five measures, However, Table 46 contains an overall 
summary of the results from these analyses. 
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Summary Table of Inferential Statistics including t-test Values for the Follow-up Raw Scores 

on Myklebust's Written Picture Story Language Test 
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Note: * - statistically significant values; N/A = not applicable; C - Control; W/0 ° e^erimental 

reading treatment without PLDK lessons; W/l ^ experimental reading treatment plus one year of PLDK 
lessons; W/2 - experimental reading treatment plus two years of PLDK lessons. 



As summary Table 46 indicates, there was a significant main effect 
for PLDK groups on four of the fi^e subtests. Again the effect was due 
to the W/0 PLDK group being superior, generally, to both the controls 
and the W/l PLDK groups. 

Significant differences between the boys and girls occurred on four 
of the five subtests, with the girls obtaining consistently superior 
scores. 

The following conclusions are drawn Concerning the PLDK treatment 
from the followup data on the Written Language Story Test analyses: 

a) Little evidence was found to support the effectiveness of 
the PLDK lessons. As on other measures, the W/0 PLDK group was 
equal to the W/2 PLDK group, but generally superior to the group 
with one year of PLDK lessons. 

b) Girls were again superior to boys on most of the measures 
of written language performance, 

6) Oral Language Development . Thn Oral Picture Story Language Test 

was a project-designed measure made to parallel Myklebust's Written 

Picture Story Language Test . As mentioned earlier, the subjects were 

again presented with a picture but this time asked to tell their stories 

orai.ly to the examiner, who in turn tape recorded them, Measures were 

obtained of productivity and level of abstraction. (There was no written 

story upon which to obtain a measure of grammatical correctness which 

* 

included punctuation, etc.) 

The means on productivity (total words, total sentences, and words 
per sentence), and degree of abstraction (abstract-concrete) scores on 
the Oral Picture Story Language Teat appear in Table 52. In contrast with 
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Table 47 

Analysis of Variance on Total Words of Myklebust's Written 
Picture Story Language Test 



Source of 


Degrees of 


Sum of 


Kean 






Variation 


Freedom 


Squares 


Square 


F Ratio 


F .90 


A (PLDK) 


3 


17823.8143 


5941.2714 


3.3224* 


2.08 


B (Boys vs. Girls) 


1 


9553.4492 


9553.4492 


5.3425* 


2.71 


A x B 


3 


10026.4233 


3342.1411 


1.8690 




Error 


346 


618715.8189 


1788.1960 






Total 


353 


656119.5057 








*p <.G5 




Table 48 








Analysis of 


Variance on 


Total Sentences 


of Kyklebust's 




Written Picture Story Language Test 






Source of 


Iteg.ees of 


Sun of 


Kean 






Varlat. _>n 


Freedcm 


Squares 


Squares 


F Ratio 


F ,90 


A (PLDK) 


3 


131.1630 


43.7210 


1.7003 


2.08 


B(Boy» vs. Girls) 


1 


146.8475 


146.8475 


5. 7111** 


2.71 


A x B 


3 


1^7.2308 


55. 7436 


2.1679* 


2.08 


Error 


H6 


8896.5102 


25.7124 






Total 


353 


9341.7515 










*p <.05 

**p <.01 
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Table 49 

Analysis of Variance on Words Per Sentence of Myklebuat's 
Written Picture Story Language Teat 



Source of 


Degrees of 


Sua of 


Mean 






Variation 


Freedom 


Squares 


Square 


F Katin 


F .90 


A (PLDK) 


3 


7402.8357 


2467.6.1 19 


3.1573* 


2.08 


B (Boys vs. Girls) 


1 


1294.7146 


1294.7146 


1.6566 


2.71 


A x B 


3 


1986.9727 


662.3242 


0.8474 


2.08 


Error 


346 


270412. 1352 


781.5379 






Total 


353 


281096.6582 








*p <.05 




Table 50 








Analysis of Variance on Syntax Quotient Scores of Myklebuat's 






Written Picture Story Language Test 






Source of 


Degrees of 


Stn of 


Mean 






Variation 


Freedom 


Squares 


Square 


F Ratio 


F .90 


A (PLDK) 


3 


568118.1198 


169372.7066 


3.0669* 


2.08 


& (Boys vs. Girls) 


1 


492203.3899 


492203.3899 


7.9713** 


2.71 


A x B 


3 


108647.2423 


36215.7474 


0.5865 


2.08 


Error 


346 


21364414.9317 


61746.8639 






Total 


353 


22531383.6837 









ERIC 



*p <.05 

**p <.oi 
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Table 51 

Analysis of Variance on Abstract-Concrete Scores of Myklebust's 
Written Picture Story Language Test 



Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Kean 

Square 


f Ratio 


F .90 


A (PLDK) 


3 


220.1734 


73.3911 


2.7891* 


2.08 


3 (Boys vs. Girls) 


1 


126.9605 


126.9605 


4.8250* 


2.71 


A x B 


3 


40.3922 


13.4640 


0.5116 


2.08 


Error 


346 


9104.1915 


26.3126 






Total 


353 


9491.7176 









*p <.05 



O 

ERLC 



the written language measure, there appeared to be a trend for those 
children receiving one year of PLDK (W/l) to be superior to the other 
groups— almost a complete reversal of the Written Picture Sto ry 
Language Test . 

The analyses of variance or the oral language data appear In 
Tables 53 through 56. 

There were two significant main effects on the PLDK dimension— on 
words per sentence measure and degtee of abstraction. In both cases, 
t.^e W/l fJLDK group was significantly superior to the W/O PLDK and control 
gr .nips . Too, for the words p r sentence measure, both the W/l and W/2 
groups were superior to the control group. 

In terms of a main effect on boys vs. gif'*, two of the four 
measures— -for total werds and wotds per sentence— were significantly in 

favot of the girls (106.62 vs. 93,26, and 10.46 vs. 9,65 respectively), 



Maan And SCaOdar d Deviation Follow-up Raw Scores on Che Oral Picture Story Language Test 
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•cor~» within this treatment group ranged from 35 to 757 words. 



Table 53 

Analysis of Variance on Total Words of the Oral 
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Picture Story Language Test 



Source of 


Degrees of 


Sum of 


Mean 






Variation 


Freedom 


Squares 


Square 


F Ratio 


F .90 


A (PLDK) 


3 


12805.1241 


4268.3747 


0.9494 


2.08 


B (Boys vs. Girls) 


1 


15786.7118 


15786.7118 


3.5113* 


2.71 


A x B 


3 


6364.4068 


2121.4689 


0.4718 


2.08 


Error 


346 


1555566.3901 


4495.8566 






Total 


353 


1590522.6328 








* 

A 

o 




Table 54 








Analysis of Variance 


on Total Sentences of thn 


Oral 






Picture Story Language Test 






Source of 


Degrees of 


Sum of 


Mean 






Variation 


Freedom 


Squares 


Square 


F Ratio 


F .90 


A (PLDK) 


3 


28.2251 


9.4083 


0.2886 


2.08 


B (Boys vs . Girls) 


1 


42.7373 


42.7373 


1.3113 


2.71 


A x 8 


3 


115.4305 


38.4768 


1...806 


2.08 


Etror 


346 


11276.0959 


32.5898 






Total 


333 


11462.4888 
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Table 55 

Analysis of Variance on Words Per Sentence of the 
Oral Picture Story Language Test 



90 



Source of 


Degrees of 


Sun of 


Mean 






Variation 


Freedom 


Squares 


Square 


T Ratio 


F .90 


A (PLDK) 


3 


7089.3711 


2363.1237 


4.4747* 


2.08 


B (Boys vs. Girls) 


1 


5873.9078 


5873.9096 


11.1228* 


2.71 


A x B 


3 


1480.7031 


493.5677 


0,9346 


2.08 


Error 


346 


182721 .2723 


528.0961 






Total 


353 


1971(5.2543 








*p < .01 




Table 56 








Analysis 


of Variance on the Abstract' 


-Concrete Scores 




of 


the Oral Picture Story Language Teat 






Source of 


L'greca of 


Sua of 


lit an 






Variation 


Freedoa 


Squares 


Square 


F Ratio 


F .90 


A (PLDK) 


3 


87.9636 


29.3212 


3.0460* 


2.08 


B (Boys vs. Girls) 


1 


0.3418 


0.3418 


0.0355 


2.71 


A x B 


3 


3.4239 


1.1413 


0.1185 


2.08 


Error 


346 


3330.6352 


9.6261 






Total 


353 


3422. j645 










*p « .05 
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finally, none of the interactions between PLDK treatments and the 
sex of pupil variable attained statistical significance. 

In light of the Above results, the following can be concluded from 
the Oral Picture Story Language Test : 

a) One year of PLDK lessons was superior to no PLDK, but no 
differences appeared between children with one and two years of 
PLDK exercises. 

b) On half the measures, the girls were significantly superior 
to the boys in oral story telling. 



SUMMARY AND CONCLUSIONS 

The two-year Cooperative Reading Project (CRP) was an outgrowth of 
our earlier Cooperative Language D evelopmen t Project (CLDP). In the 
Cooperative Language Deyelopaert Project , we investigated, with Southern 
disadvantaged children in the pristary grades, the efficacy of the Initial 
Teaching Alphabet (1TA) in teaching beginning reading, and Levels #1, 

#2, and #3 of the Peabody Languag e Development Kits (PLDK) In stimulating 
oral langutge, verbal intelligence, creative thinking, sod school 
achievement. Tie experiment proper extended over the first three grades 
when the posttest measures were obtained. The children were followed up 
through their fourth grade. While much of the earlier pupil progress was 
later lost at the time of follcvup testing, the results at interim and 
posttesting were very positive, with the ITA and PLDK treatment groups 
being generally more advanced than the controls, especially for childten 
who hai ItA in combination with two or thtee years of PLDK lessons. On 
the basis of these positive results, it might have been concluded that a 
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language p ,'ogram using ITA plus PLDK should be incorporated into school 
programs for disadvantaged children. However the possibility existed that 
these results may have been due to a number of factors beyond the 
control of the project staff. Since school assignments to experimental 
treatments were made by the central office staff of the school system, 
selection bias may have been inadvertently introduced. Too, within each 
school, only volunteer teachers were included. Moreover, the Hawthorne 
Effect cannot be ignored. The experimental teachers were given a number 
of incentives which were not available to the control teachers--inciuding 
a saall salary supplement, in-service training sessions, consultative 
services, as well as the stimulation created by the novelty of being 
involved in the experimental treatments. Furthermore, frequent visits 
to the experimental classes were made by reseatchers, school officials, 
and visitors who praised the pupils' progress. The question thus arises 
as to whether the Initial Teaching Alphabet And the Peabody Language 
Development Kit materials would continue to be effective when this study 
was replicated with other teachers, and with other approaches to 
beginning reading where similar extra support and incentives were 
included. The central purpose of the Coop e rative Reading Project (CRP) 
was to deal with this question. As in the first study, subjects were 
disadvantaged children from inner-city primary grades, about 80 per cent 
of whom were Negro. With teacher incentives and support equated, the 
relative effectiveness of three experiaental approaches to teaching 
beginning reading was compared. Also, the influence on language 
development of a ptogfat of oral language stimulation which continued 
through grades one and two was studied. The three experimental reading 




treatments were: 
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a) the Initial Teaching Alphabet (ITA), b) the Words -ln-Color program 
(WIC) , and c) a Supplemented Conventional Reading Program (SCRP) which 
consisted of a basic reader plus the Hay-Wingo phonic materials, All 
three reading approaches tended to be phonetically rather than look-and- 
8ay oriented. In addition to the reading treatment, some of the experi- 
mental subjects received oral language stimulation in the first grade 
from Level #1 of the Peabody Language Development Kits, while others 
received still a second year of treatment from Level 12 of these same 
series of Kits. 

From 12 public elementary school in the inner-city area a total of 
538 8ubject8--473 in the combined experimental group and 65 controls 
constituted the subject pool. Since the treatments were provided by 
the classroom teachers to the entire class, treatment groups were 
neither equal in number nor on certain other inpuilanl attributes. Thus, 
selected samples were drawn from the entire group for purposes of 
statistical analysis. 

Nire experimental treatment groups and a control group were estab- 
lished, each Consisting of three teachers who were committed to keep 
their pupils through both of the first two grades: a) Grotip 1 used ITA 

followed by the Lippincott Basic Readers without PLDK, b) Group 2 used 
ITA tollcwed by the Lippincott Basic Readers , plus one year of PIDK, 
c) Group 3 used ITA follwed by the Lippincott Basic Readers , plus two 
years of FLDK, d) Group 4 used WIC follcwed by the Houghton Mifflin 
Basic Readets without PLDK, e) Group 5 used Wotda - lh-Colot followed by 
the Houghton Mifflin Basic Readet s , plus one yeat of PLUK, f) Group 6 




used WIC follcved by Houghton Mifflin Basic Readets and the Hay-Wingo 
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phonic materials without PLDK, g) Croup 8 used the Houghton Mifflin Basal 
Readers and the Hay-Wingo phonic materials plus one year of PLDK, 
h) Group 9 used the Houghton Mifflin B asal Readers and the Hay-Wingo 
phonic materials, plus two years of PLDK, and i) Group 10 was a control 
group which did not receive the experimental program, (Many of the 
control children came from the only elementary school in the district 
accredited by the Southern Association of Colleges and Schools. It is 
possible that the experimental treatments could be expected to do little 
more than equalise this bias,) 

The effectiveness of the program was evaluated by means of six 
measures: a) general intellectual functioning with the 1960 Stanfocd - 

Binet Intelligence Test , b) psycholinguistic development with the experi- 
mental edition of the Illinois Test of Psycholinguistic Abilities , 

c) creative thinking with the Torrance Tests of Crest lve Thinking , 

d) scholastic achievement with the Metropolitan Achievement Tests , 

e) written language development with Myklebuat's Written Picture Story 
Language Test , and f) oral language development with a project-developed 
Oral Picture Story Language Tes t. The pretesting was done at the cutset 
of the 1965-66 school year; the posttesting was completed in the Spring, 
1967; the followup testing was done in the Spring, 1968. At time of 
followup testing, data were obtained on 354 subjects — 306 in the experi- 
mental treatment and 48 in the control group. These data were analysed 
using analyses of variance, with t-teata used oft significant main effects 
and interact lofts. 

The data were first examined using a 3 x 3 x 2 factorial analysis 

of variance to contrast the three experimental reading programs in 

0 
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combi nation with the three oral language stimulation treatments by sex. 

(No control subject data were included in this treatment of the data.) 

The following six findings resulted: 

a) In terms of IQ scores on the 1900 Stanford-Binet Intelligence 
Test , neither at posttesting nor followup testing did the PLDK 
exercises have a differential effect with all groups increasing 
significantly from pre- to post-testing; a shocking finding was 

that the IQ scores generally had fallen back to initial levels by 
time of followup testing, 

b) In terms of overall LA scores on the Illinois Test of 
Psycholingula tic Abilities , generally the PIDK lessons did not 
prove effective in raising LA scores. 

c) In terms of total verbal subtest scores on the Torrance 
Tests of Creative Thinking , both one and two years of PLDK exercises 
resulted in significantly improved performance. 

d) In terms of total written language subtest scores on the 
Metropolitan Achievement Tests , the SCRP treatment was superior 

at the end of the two-year experimental period, but this differential 
was lost by time of followup; only slight evidence was found that 
the PLDK lessons tended to equalise pupil progress of boys to the 
level attained by the girls, 

e) On Hykiebuat’s Written Picture Story Languag e Test, little 
evidence was found to support the effectiveness of the PLDK lessons. 

f) On Out Oral Picture Story L anguage Teat , at followup, 
children with one year of PLDK exercises performed significantly 
better than thote without, or with two yeara of Such lessons. 



96 



The data were analyzed a second time using a 4 x 2 analysis of 
variance to contrast the three experimental PLDK conditions plus the con- 
trol group, by the sex of -pupils dimension. The findings closely 
paralled those of the first analysis. Only important new information is 
outlined below: 

a) In terms of IQ scores, no new information was obtained, 

b) In terms of language age scores on the ITPA, all three 
experimental PLbK conditions obtained higher followup scores than 
the control subjects. 

c) No new information was obtained concerning scores on the 
Torrance Test s of Creative Thinking . 

d) In teias of written lenguage scores on the Metropolitan 
Achievement I eats , at the conclusion of the two-year experimental 
period all three experimental PLDK conditions were superior to the 
controls, with only the non-PLDK experimental reading group being 
superior to the control subjects at followup testing. 

e) No new information was learned from the second analysis of 
scores on Hyklebust’s Written Picture Story Language Test . 

f) In terms of scores on the Oral Picture Story Language Test, 
no new information was provided by the second analysis. 

The results of the C operative Reading Project did not confirm the 
highly positive results obtained for 1TA and PLDK in the Cooperative 
Language Dev el opment Project . In this second study what little 
advantage had existed fot the Supplemented Conventional Reading Ptogtaa 
in terms of academic achievement at time of posttesting was lost by 
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followup time. As for the lessons from the Peabody Language Develop- 
ment Kits , only scores on the Torr ance Tests of Creative Thinkin g and 
on our Oral Picture S tory Language Tests were enhanced by time of* 
followup , 

Explanations for these differences in findings are many. First, 
one cannot discount the fact that the Hawthorne Effect may have contri- 
buted appreciably to the results of the first study. Second, the two 
new experimental reading programs, namely Words-in-Color and the Supple- 
mented Conventional Reading Program were conducted in schools not involved 
in the first experiment, whereas the ITA was conducted in the same schools 
as the first experiment. This may have resulted in the better teachers 
in the schools being selected for the first experiment. Thus, first- 
selected teachers in the WIG and supplemented conventional reading 
approaches would be competing with second-selected teachers in the 
Initial Teaching Alphabet approach. Finally, an examination of the 
differences in the mean gains across classrooms within each method 
indicated that teacher variability was as great as reading method 
variability . 

Perhaps a concluding comment is in orde: r ter devoting four years 

to the Cooperative Language Deve?.opment P? ]e and three years to the 
Cooperative Reading Project , the researchei t this investigation were 
forced to conclude that, without controls or differences in teacher 

effectiveness, future research which attem t iscern the relative 
effectiveness of different methods of teac tinning reading and/or 

oral language will probably continue to b< f 1* , or the results 
spurious. Either such comparisons of diff^ iterventions should be 
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tabled until more is known about measuring and controlling for the teacher 
variable, or research designs should be utilized in which the teacher is 
kept constant across treatments. This might necessitate the use of some 
type of counter-balanced design in which a group of teachers would use 
one method for one or more years and a different method (with comparable 
children) for another one or more years, or in which the same teachers 
provide instruction in two or more experimental approaches within the 
same school day. Until these more sophisticated procedures and/or 
measures are available, it would not seem to be feasible to engage in 
additional studies such as this one which has consumed much of our 
energies over these past four years. 
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